-- Logs begin at Wed 2022-05-25 13:01:56 UTC, end at Wed 2022-05-25 13:56:37 UTC. -- May 25 13:35:00.196334 dv-cinder-787296-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 25 13:35:00.206977 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 13:35:00 2022] *** May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: nodename: dv-cinder-787296-8-iscsi May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: machine: x86_64 May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: clock source: unix May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: pcre jit disabled May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: detected number of CPU cores: 4 May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: current working directory: / May 25 13:35:00.208990 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: detected binary path: /usr/bin/uwsgi-core May 25 13:35:00.209642 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: your processes number limit is 47680 May 25 13:35:00.209642 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: your memory page size is 4096 bytes May 25 13:35:00.209642 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: detected max file descriptor number: 2048 May 25 13:35:00.209642 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: lock engine: pthread robust mutexes May 25 13:35:00.209642 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: thunder lock: enabled May 25 13:35:00.209642 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 13:35:00.209642 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 13:35:00.253421 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: Python main interpreter initialized at 0x556903f419c0 May 25 13:35:00.253421 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: python threads support enabled May 25 13:35:00.253421 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: your server socket listen backlog is limited to 100 connections May 25 13:35:00.253421 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: your mercy for graceful operations on workers is 90 seconds May 25 13:35:00.253767 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: mapped 403077 bytes (393 KB) for 2 cores May 25 13:35:00.253855 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: *** Operational MODE: preforking *** May 25 13:35:00.254127 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: *** uWSGI is running in multiple interpreter mode *** May 25 13:35:00.254127 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: spawned uWSGI master process (pid: 86836) May 25 13:35:00.254313 dv-cinder-787296-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 25 13:35:00.255120 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: spawned uWSGI worker 1 (pid: 86846, cores: 1) May 25 13:35:00.255234 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: spawned uWSGI worker 2 (pid: 86847, cores: 1) May 25 13:35:00.255314 dv-cinder-787296-8-iscsi devstack@keystone.service[86836]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 13:35:05.889247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:35:05.889247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: from cryptography.utils import int_from_bytes May 25 13:35:05.890027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:35:05.890027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: from cryptography.utils import int_from_bytes May 25 13:35:05.890167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:35:05.890167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: from cryptography.utils import int_from_bytes May 25 13:35:05.890167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 13:35:05.890167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: from cryptography.utils import int_from_bytes May 25 13:35:05.938500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 13:35:05.938691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 13:35:05.938841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 13:35:05.938941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] command line args: [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 13:35:05.939031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 13:35:05.939136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 13:35:05.939226 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] command line args: [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 13:35:05.939302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ================================================================================ {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 13:35:05.939473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 13:35:05.939556 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] admin_token = **** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.939639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ================================================================================ {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 13:35:05.939779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] config_dir = [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.939893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] admin_token = **** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.939982 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.940128 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] config_source = [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.940208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] config_dir = [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.940294 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] debug = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.940376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.940481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] config_source = [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.940568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.940801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] debug = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.940974 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941554 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941789 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] list_limit = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.941996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] log_config_append = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] list_limit = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] log_config_append = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] log_dir = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] log_file = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] log_dir = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.942947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943032 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] log_file = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943534 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943912 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.943997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944073 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944403 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944480 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.944964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945120 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945754 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.945935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.946104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.946283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] publish_errors = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.946431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.946553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.946650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] publish_errors = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.946734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.946813 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.946893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947044 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] standard_threads = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947673 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] standard_threads = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.947995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] use_journal = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] use_json = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948625 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] use_stderr = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] use_journal = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] use_syslog = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.948861 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] use_json = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.949010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.949090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] use_stderr = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.949170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] use_syslog = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.949263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.949397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 13:35:05.949500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.949653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.958927 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.959123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.959334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.959546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.959686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.959686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.960215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.960349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.960481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.960695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.960832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.960963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.961094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.961224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.961354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.961505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.961644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.961811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.961950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.962090 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.962223 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.962362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.962500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.962630 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.962762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.962967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.963209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.963209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.963209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.963209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.963209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.963209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.964311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.964452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.964585 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.964723 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.964856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.964993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.965160 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.965306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.965440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.965696 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.966196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.966342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.966481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.966623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.966757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.966897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.967096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.967235 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.967367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.967506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.967638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.967768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.968031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.968306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.969202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.969851 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.970146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.970364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.970364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.970576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.970689 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.970824 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.970943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.971081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.971264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.971264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.971264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.971666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.971846 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.972031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.972181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.972386 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.972560 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.972738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.972831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.973046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.973186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.973318 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.973457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.973596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.973750 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.975246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.975541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.975877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.976637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.976856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.977182 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.977707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.978280 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.979170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.979498 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.979813 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.980025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.980287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.980636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.980918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.981128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.981327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.981661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.981661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.982243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.982496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.982496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.983423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.983997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.984215 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.984397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.984548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.984743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.986117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.986302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.986443 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.986576 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.986723 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.986872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.987024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.987198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.987343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.987581 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.987724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.988022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.988022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.988518 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.988849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.989262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.989402 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.989543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.989686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.989857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.989994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.990138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.990291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.990425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.990557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.990709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.990842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.990973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.991183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.991673 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.991810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.991810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.992073 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.992206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.992206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.992206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.992576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.992576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.992824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.992824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.993085 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.993217 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.993424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.993424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.993684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.993892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.994108 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.994294 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.994442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.994995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.995291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.995433 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.995579 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.995717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.995860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.995994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.996140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.996275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.996380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.996538 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.996683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.997764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.997960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.998179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.998387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.998387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.998844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.999175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.999321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.999453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.999582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.999711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.999840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:05.999840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.000101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.000237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.000365 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.000493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.000620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.000748 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.000896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.001027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.001154 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.001283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.001417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] auth.external = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.001548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.001687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.001836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.001914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002164 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] auth.password = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] auth.token = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.002973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] auth.external = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003442 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003519 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003594 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003675 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] credential.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.003839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] auth.password = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] auth.token = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004477 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.004876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005240 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] credential.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005549 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005706 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005706 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.005951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006174 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] federation.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006731 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.006969 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.007973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008122 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] federation.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008279 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.008986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009377 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.009967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010222 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010524 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010524 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010743 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010818 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.010966 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011422 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011876 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.011959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.012035 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.012109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.012183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.012257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.012331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.012413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013359 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013518 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013841 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.013916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014549 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014861 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.014945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015097 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015097 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015232 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015862 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.015939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016164 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.016931 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.017941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018091 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018488 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018709 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.018933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019680 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.019995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020072 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020693 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020768 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.020926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021384 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.021988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022139 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022375 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.022953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] resource.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023376 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023525 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023605 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023905 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.023988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024187 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024412 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] resource.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] role.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] role.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.024950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025101 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.025957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] role.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] role.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026182 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.026948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027097 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027180 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027180 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.027987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.028929 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029564 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029713 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.029937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030026 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] token.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030569 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.030952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031027 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031101 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] token.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031865 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.031940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032163 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032554 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032628 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.032994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.connection = **** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033156 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033325 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.033940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.connection = **** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034701 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034776 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.034935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035377 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035826 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035826 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.035964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.036038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 13:35:06.036114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.036114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.036114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.036114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.036114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.036114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.036114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 13:35:06.036114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 13:35:06.057977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.058110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.058191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.058269 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.058376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.058478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.067557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.067657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.096138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.096268 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.096368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.096449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.150834 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.153384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.202770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.202989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.203787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.204025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.268764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.268990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.269212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.269320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.269429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.269514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.269642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.269772 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.269872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.269952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.270131 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.270349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.292759 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.293013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.293209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.293296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.293426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.293518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.293638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.294242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.294386 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.294470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.294598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.294680 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.294808 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.295020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.305847 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.306327 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.318855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319658 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319735 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.319942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.320066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.320161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.320312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 13:35:06.339486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.339688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:35:06.340023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.340125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.340206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:35:06.340283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:35:06.340479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.340648 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.340765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.340859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 13:35:06.341021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.341105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.341275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.341357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.341605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.341890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.352214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.352489 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.352755 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.352894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.353033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.353171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.353438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.353717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.361615 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.362392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.364895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.365171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.365448 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.365657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.365771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.365960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.366044 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.366240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.366324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.366503 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.366598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.366786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.366868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.367047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.367130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.367316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.367400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.367651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.367733 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.367953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.368228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.368502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.394318 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.395411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.396028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.396306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.397144 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.397425 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.401532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.401834 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.402119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.402724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.403007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.403803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.409898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.410178 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.411121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.411404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.414619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.415018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.415301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.415582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.415854 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.415936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.416123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.416293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.416376 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.416581 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.416666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.416864 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.417140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.417414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.417684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.417977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.435826 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.436106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.437121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.437406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.440760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.442123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.444426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.444719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.445788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.446086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.449714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.451140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.453320 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.454752 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.457110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.457409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.457699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.458005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.458289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.458527 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.458616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.458828 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.459123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.459421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.459699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.460229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.478122 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.478401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.478668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.478928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.479690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.479981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.480247 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.480509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.487487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.489054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.489190 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.489477 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.490809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.491085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.492513 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.492792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.493070 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.493352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.493627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.494150 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.494434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.494715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.494999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.495288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.506996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.507275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.507556 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.507834 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.508110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.508380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.508659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.509020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.509303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.509587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.509906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.510188 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.510463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.510746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.526636 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.529321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.530410 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.532618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.533704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.535320 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.535965 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.536934 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.537223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.537503 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.537588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.539195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.539487 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.539778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.545485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.547118 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.547734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.549357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.550357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.550646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.550927 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.551205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.552787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.553079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.553365 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.553647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.560289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.560572 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.560950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.562801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.563091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.563476 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.568779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.569097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.569337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.569609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.569903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.570183 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.570467 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.570741 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.571017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.571281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.571411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 13:35:06.571540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.571679 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.571809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.571941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.572079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.572293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.572426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.572556 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.572685 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.572947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.573225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.573505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.573801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.574073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.574334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.574604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.574875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 13:35:06.612091 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556903f419c0 pid: 86847 (default app) May 25 13:35:06.614808 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556903f419c0 pid: 86846 (default app) May 25 13:35:06.615346 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e274-99bd-4027-b597-a20550b0c300 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:06.615639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e274-99bd-4027-b597-a20550b0c300 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:06.615918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e274-99bd-4027-b597-a20550b0c300 None None] PATH_INFO: `/v3` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:06.620185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Wed May 25 13:35:06 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:14.484412 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777838b-e044-44db-88f4-5c1435c76025 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:14.484980 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777838b-e044-44db-88f4-5c1435c76025 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:14.484980 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777838b-e044-44db-88f4-5c1435c76025 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:14.489418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:14.494731 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:14.495162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:14.495290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:14.563086 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: INFO dbcounter [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] Registered counter for database keystone May 25 13:35:14.584192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG oslo_db.sqlalchemy.engines [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 13:35:14.590812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writer thread running {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 13:35:14.769287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG passlib.handlers.bcrypt [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86847) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 13:35:14.769631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG passlib.handlers.bcrypt [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86847) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 13:35:14.826408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:14.828048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:14.953218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 13:35:15.160322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777838b-e044-44db-88f4-5c1435c76025 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:15.229465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: INFO dbcounter [None req-6777838b-e044-44db-88f4-5c1435c76025 None None] Registered counter for database keystone May 25 13:35:15.248948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG oslo_db.sqlalchemy.engines [None req-6777838b-e044-44db-88f4-5c1435c76025 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 13:35:15.255191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writer thread running {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 13:35:15.383115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777838b-e044-44db-88f4-5c1435c76025 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:15.388796 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3d034-e7ca-4303-9268-dc325d9b3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:15.389458 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d034-e7ca-4303-9268-dc325d9b3b01 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:15.389769 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d034-e7ca-4303-9268-dc325d9b3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:15.390055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d034-e7ca-4303-9268-dc325d9b3b01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:15.398363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3d034-e7ca-4303-9268-dc325d9b3b01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:15.455661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e2a3d034-e7ca-4303-9268-dc325d9b3b01 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 13:35:15.456013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3d034-e7ca-4303-9268-dc325d9b3b01 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:15.467432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Wed May 25 13:35:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 13:35:15.473496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:15.487972 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c0f56-05eb-4aea-b1a7-6ea61621a861 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:15.492416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89343bcc-7dcc-46d2-824c-8dcd54adfb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:15.493536 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343bcc-7dcc-46d2-824c-8dcd54adfb12 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:15.493872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343bcc-7dcc-46d2-824c-8dcd54adfb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:15.494161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343bcc-7dcc-46d2-824c-8dcd54adfb12 admin admin] PATH_INFO: `/v3/projects/48375e55fddc4df099c1a83243da1d15` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:15.495679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89343bcc-7dcc-46d2-824c-8dcd54adfb12 admin admin] RBAC: Authorizing `identity:get_project(project_id=48375e55fddc4df099c1a83243da1d15)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:15.655552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING keystone.common.rbac_enforcer.enforcer [None req-89343bcc-7dcc-46d2-824c-8dcd54adfb12 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 13:35:15.655900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89343bcc-7dcc-46d2-824c-8dcd54adfb12 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:15.660630 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Wed May 25 13:35:15 2022] GET /identity/v3/projects/48375e55fddc4df099c1a83243da1d15 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:17.917278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e10e-a5ea-48fb-81af-359b422ce848 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:17.917826 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e10e-a5ea-48fb-81af-359b422ce848 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:17.917928 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e10e-a5ea-48fb-81af-359b422ce848 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:17.922563 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:17.928088 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2982a-be69-4f67-a1bd-75ae99a9ceac None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:17.928516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2982a-be69-4f67-a1bd-75ae99a9ceac None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:17.928653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2982a-be69-4f67-a1bd-75ae99a9ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:17.947122 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-3cb2982a-be69-4f67-a1bd-75ae99a9ceac None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:17.948627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-3cb2982a-be69-4f67-a1bd-75ae99a9ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:17.956342 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 13:35:17.983229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e10e-a5ea-48fb-81af-359b422ce848 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:17.995191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e10e-a5ea-48fb-81af-359b422ce848 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:18.000390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4449d-c92c-46d9-b95e-1818abe19041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:18.001051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4449d-c92c-46d9-b95e-1818abe19041 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:18.001339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4449d-c92c-46d9-b95e-1818abe19041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:18.001617 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4449d-c92c-46d9-b95e-1818abe19041 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:18.010368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4449d-c92c-46d9-b95e-1818abe19041 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:18.012139 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4449d-c92c-46d9-b95e-1818abe19041 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:18.020795 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Wed May 25 13:35:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 13:35:18.026658 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2982a-be69-4f67-a1bd-75ae99a9ceac None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:18.036272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2982a-be69-4f67-a1bd-75ae99a9ceac None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:18.040683 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce741252-d649-46c9-9a15-b3e73b50e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:18.041552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741252-d649-46c9-9a15-b3e73b50e014 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:18.041877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741252-d649-46c9-9a15-b3e73b50e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:18.042162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741252-d649-46c9-9a15-b3e73b50e014 admin admin] PATH_INFO: `/v3/users/082a7280c91e421382a44e080705c894` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:18.044228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce741252-d649-46c9-9a15-b3e73b50e014 admin admin] RBAC: Authorizing `identity:get_user(user_id=082a7280c91e421382a44e080705c894)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:18.046072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce741252-d649-46c9-9a15-b3e73b50e014 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:18.047662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Wed May 25 13:35:18 2022] GET /identity/v3/users/082a7280c91e421382a44e080705c894 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:20.267775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd9ca-bc69-4f21-81eb-1e3d3bc965ce None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:20.268295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd9ca-bc69-4f21-81eb-1e3d3bc965ce None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:20.268408 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd9ca-bc69-4f21-81eb-1e3d3bc965ce None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:20.269682 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:20.274879 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3506e-14a2-4511-9d27-9b66e9d16337 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:20.275301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3506e-14a2-4511-9d27-9b66e9d16337 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:20.275452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3506e-14a2-4511-9d27-9b66e9d16337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:20.292567 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-09a3506e-14a2-4511-9d27-9b66e9d16337 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:20.294377 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-09a3506e-14a2-4511-9d27-9b66e9d16337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:20.319803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3ba2-ac31-4671-b87d-105f42246020 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:20.320100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3ba2-ac31-4671-b87d-105f42246020 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:20.320385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3ba2-ac31-4671-b87d-105f42246020 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:20.321775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:20.327282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:20.327587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:20.327866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:20.368522 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG passlib.handlers.bcrypt [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86846) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 13:35:20.368958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG passlib.handlers.bcrypt [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86846) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 13:35:20.393451 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:20.415941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:20.417038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3506e-14a2-4511-9d27-9b66e9d16337 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:20.417567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:20.442715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:20.521577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:20.529511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3506e-14a2-4511-9d27-9b66e9d16337 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:20.543262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:20.565403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63a298-68f5-4cf8-b041-6a5a19972848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:20.566247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a298-68f5-4cf8-b041-6a5a19972848 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:20.566543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a298-68f5-4cf8-b041-6a5a19972848 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:20.566828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a298-68f5-4cf8-b041-6a5a19972848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:20.578269 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63a298-68f5-4cf8-b041-6a5a19972848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-cf63a298-68f5-4cf8-b041-6a5a19972848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:20.591133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:20.592309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:20.593328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:20.598588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63a298-68f5-4cf8-b041-6a5a19972848 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:20.694306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:20.713370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63a298-68f5-4cf8-b041-6a5a19972848 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:20.748651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:20.749325 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:20.749613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:20.749933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:20.750683 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:20.750998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:20.752423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:20.753350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e66636-1077-42c1-974f-5ffbec9eb863 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:20.755650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:20.764580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:20.770061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:20.792682 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603dd4-b9f3-496f-a596-cb7914b5dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:20.794715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603dd4-b9f3-496f-a596-cb7914b5dfef None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:20.794715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603dd4-b9f3-496f-a596-cb7914b5dfef None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:20.794886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603dd4-b9f3-496f-a596-cb7914b5dfef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:20.863189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603dd4-b9f3-496f-a596-cb7914b5dfef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:20.864750 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603dd4-b9f3-496f-a596-cb7914b5dfef None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:20.870881 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b325e-f807-45db-b521-27fa64352308 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:20.905835 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97eed-a9cb-4abd-ab7b-7bc080f99930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:20.906715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97eed-a9cb-4abd-ab7b-7bc080f99930 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:20.907009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97eed-a9cb-4abd-ab7b-7bc080f99930 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:20.907296 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97eed-a9cb-4abd-ab7b-7bc080f99930 None admin] PATH_INFO: `/v3/users/082a7280c91e421382a44e080705c894` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:20.908518 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc97eed-a9cb-4abd-ab7b-7bc080f99930 None admin] RBAC: Authorizing `identity:get_user(user_id=082a7280c91e421382a44e080705c894)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:20.910042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc97eed-a9cb-4abd-ab7b-7bc080f99930 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:20.911869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 9/16] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:20 2022] GET /identity/v3/users/082a7280c91e421382a44e080705c894 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:20.917099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97eed-a9cb-4abd-ab7b-7bc080f99930 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:20.932143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:20.965251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 8/17] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:35:20.970861 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603dd4-b9f3-496f-a596-cb7914b5dfef None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:20.973702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:21.024626 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97eed-a9cb-4abd-ab7b-7bc080f99930 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:21.058825 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61ab38-0198-467a-bd0d-e441704f39e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:21.060079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61ab38-0198-467a-bd0d-e441704f39e1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:21.060359 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61ab38-0198-467a-bd0d-e441704f39e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:21.060630 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61ab38-0198-467a-bd0d-e441704f39e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:21.061832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61ab38-0198-467a-bd0d-e441704f39e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:21.063302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61ab38-0198-467a-bd0d-e441704f39e1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:21.065074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:21.069276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603dd4-b9f3-496f-a596-cb7914b5dfef None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:21.070545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61ab38-0198-467a-bd0d-e441704f39e1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:21.103098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:21.103910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:21.104198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:21.104483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:21.125316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:21.126844 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:35:21.147326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:21.148298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:21.149262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:35:21.149262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:35:21.149262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:35:21.149262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:21.149262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:35:21.152484 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:21.154572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:21.173063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61ab38-0198-467a-bd0d-e441704f39e1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:21.206516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e74b0e-5415-4b3f-b1aa-14d4f3fabfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:21.207181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74b0e-5415-4b3f-b1aa-14d4f3fabfc8 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:21.207465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74b0e-5415-4b3f-b1aa-14d4f3fabfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:21.207747 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74b0e-5415-4b3f-b1aa-14d4f3fabfc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:21.208582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e74b0e-5415-4b3f-b1aa-14d4f3fabfc8 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.domain.id=default, user.id=082a7280c91e421382a44e080705c894) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:21.208899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e74b0e-5415-4b3f-b1aa-14d4f3fabfc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:21.210651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e74b0e-5415-4b3f-b1aa-14d4f3fabfc8 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:21.213156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:21.217505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Wed May 25 13:35:21 2022] GET /identity/v3/role_assignments?user.id=082a7280c91e421382a44e080705c894&scope.domain.id=default&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:21.265441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df445d-12f2-4431-9e2f-0bca4d93d3c6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:21.302122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dfce3-ab39-4952-8bc4-eabd4a589226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:21.302811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dfce3-ab39-4952-8bc4-eabd4a589226 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:21.303082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dfce3-ab39-4952-8bc4-eabd4a589226 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:21.303368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dfce3-ab39-4952-8bc4-eabd4a589226 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:21.304125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0dfce3-ab39-4952-8bc4-eabd4a589226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:21.304441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0dfce3-ab39-4952-8bc4-eabd4a589226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:21.305904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0dfce3-ab39-4952-8bc4-eabd4a589226 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:21.325780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:23.886987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c726b-72ae-4980-89c0-89dd23e03047 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:23.887992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c726b-72ae-4980-89c0-89dd23e03047 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:23.888474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c726b-72ae-4980-89c0-89dd23e03047 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:23.890341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:23.896046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a593a08-1d27-45ce-af6a-f02049797ea8 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:23.896898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a593a08-1d27-45ce-af6a-f02049797ea8 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:23.897377 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a593a08-1d27-45ce-af6a-f02049797ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:23.934823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-4a593a08-1d27-45ce-af6a-f02049797ea8 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:23.936375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-4a593a08-1d27-45ce-af6a-f02049797ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:24.030755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:24.063573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c726b-72ae-4980-89c0-89dd23e03047 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:24.154666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ba5c-35b8-4d56-a55b-40731d7f14d7 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.155330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ba5c-35b8-4d56-a55b-40731d7f14d7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.155813 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ba5c-35b8-4d56-a55b-40731d7f14d7 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.157434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:24.162759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e1b78-9a73-42dc-a77a-9ac1c3669f43 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.163301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e1b78-9a73-42dc-a77a-9ac1c3669f43 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.163778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e1b78-9a73-42dc-a77a-9ac1c3669f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.191093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b85e1b78-9a73-42dc-a77a-9ac1c3669f43 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:24.194500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b85e1b78-9a73-42dc-a77a-9ac1c3669f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:24.268569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c726b-72ae-4980-89c0-89dd23e03047 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:24.272372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:24.338570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:24.350313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:24.351124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.351413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.351696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.366933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:24.368434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:24.374784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:24.376481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e1b78-9a73-42dc-a77a-9ac1c3669f43 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:35:24.424583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:24.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:24.426807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:35:24.426807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:35:24.426807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:35:24.426807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:24.426807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 13/26] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:24.432934 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:24.549039 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e1b78-9a73-42dc-a77a-9ac1c3669f43 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:24.587332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e9e4b-1632-4072-8736-79a3035174e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:24.588430 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9e4b-1632-4072-8736-79a3035174e4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.588919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9e4b-1632-4072-8736-79a3035174e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.589349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9e4b-1632-4072-8736-79a3035174e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.602314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e9e4b-1632-4072-8736-79a3035174e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-a82e9e4b-1632-4072-8736-79a3035174e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:24.612166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:24.613213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:24.614233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:24.616477 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 14/27] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:24.617923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292360-5b75-49c4-818f-04376651cb13 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.618262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c616e-0064-44f8-bd1f-37fe605f7a5e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:24.618545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292360-5b75-49c4-818f-04376651cb13 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.618979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292360-5b75-49c4-818f-04376651cb13 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.620546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 15/28] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:24.622601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28462a-9f39-4b35-810e-82b23747f791 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.623052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28462a-9f39-4b35-810e-82b23747f791 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.623466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28462a-9f39-4b35-810e-82b23747f791 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.624862 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 16/29] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:24.630960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6656cc-926c-4416-9075-de0386a94bdb None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.631520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6656cc-926c-4416-9075-de0386a94bdb None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.631913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6656cc-926c-4416-9075-de0386a94bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.652666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-df6656cc-926c-4416-9075-de0386a94bdb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:24.654185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-df6656cc-926c-4416-9075-de0386a94bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:24.665116 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:24.666103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.666533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.667051 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.667920 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:24.668413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:24.670120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:24.688361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:24.690714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 14/30] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:24.691783 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:24.743945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 17/31] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:24.745778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5024109-b062-4eb5-9fb7-4d5ee1d80247 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.746087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5024109-b062-4eb5-9fb7-4d5ee1d80247 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.746888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5024109-b062-4eb5-9fb7-4d5ee1d80247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.763438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:24.770798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-c5024109-b062-4eb5-9fb7-4d5ee1d80247 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:24.772787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-c5024109-b062-4eb5-9fb7-4d5ee1d80247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:24.829526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad85cc-5454-41cb-bbf4-67c3e4af93af None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:24.868364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 18/32] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:24.869611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5024109-b062-4eb5-9fb7-4d5ee1d80247 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:24.878149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:24.879253 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:24.879554 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:24.879842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:24.880604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:24.880918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:24.882757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:24.893481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 15/33] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:24.894363 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:24.974666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:24.983243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5024109-b062-4eb5-9fb7-4d5ee1d80247 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:25.004169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d471ac-9b3b-4f30-9f4b-0d0da49ff9ad None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:25.024355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:25.026025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4381d5-c600-4af9-8c17-0f956511d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:25.026997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4381d5-c600-4af9-8c17-0f956511d483 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.027498 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4381d5-c600-4af9-8c17-0f956511d483 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.028091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4381d5-c600-4af9-8c17-0f956511d483 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.029347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4381d5-c600-4af9-8c17-0f956511d483 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:25.031355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4381d5-c600-4af9-8c17-0f956511d483 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:25.044233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd82d-bd5e-4ae9-8a23-9b98cbcf60be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:25.045123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd82d-bd5e-4ae9-8a23-9b98cbcf60be None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.045250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd82d-bd5e-4ae9-8a23-9b98cbcf60be None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.045479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd82d-bd5e-4ae9-8a23-9b98cbcf60be None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.046291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabd82d-bd5e-4ae9-8a23-9b98cbcf60be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:25.047742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabd82d-bd5e-4ae9-8a23-9b98cbcf60be None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:25.178585 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 16/34] 10.222.0.13 () {60 vars in 1131 bytes} [Wed May 25 13:35:24 2022] POST /identity/v3/roles => generated 219 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:25.179562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd82d-bd5e-4ae9-8a23-9b98cbcf60be None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:25.187271 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 19/35] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:35:24 2022] POST /identity/v3/projects => generated 301 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:25.188722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4381d5-c600-4af9-8c17-0f956511d483 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:25.346066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd82d-bd5e-4ae9-8a23-9b98cbcf60be None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:25.349013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4381d5-c600-4af9-8c17-0f956511d483 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:25.405271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d5141-91a8-4446-b86f-ff65c30e7ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:25.406782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5141-91a8-4446-b86f-ff65c30e7ff0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.407384 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5141-91a8-4446-b86f-ff65c30e7ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.407888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5141-91a8-4446-b86f-ff65c30e7ff0 None admin] PATH_INFO: `/v3/users/082a7280c91e421382a44e080705c894` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.410646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d5141-91a8-4446-b86f-ff65c30e7ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=082a7280c91e421382a44e080705c894)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:25.412689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d5141-91a8-4446-b86f-ff65c30e7ff0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:25.414864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 17/36] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:25 2022] GET /identity/v3/users/082a7280c91e421382a44e080705c894 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:25.421704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d5141-91a8-4446-b86f-ff65c30e7ff0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:25.455216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d3235-9134-480b-a610-e16aad70f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:25.456355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d3235-9134-480b-a610-e16aad70f6bd None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.456849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d3235-9134-480b-a610-e16aad70f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.457343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d3235-9134-480b-a610-e16aad70f6bd None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.458389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d3235-9134-480b-a610-e16aad70f6bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:25.460708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d3235-9134-480b-a610-e16aad70f6bd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:25.500764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 20/37] 10.222.0.13 () {60 vars in 1131 bytes} [Wed May 25 13:35:25 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:25.504255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c35b-288c-4522-ae9f-d8dbe2e04bbd None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.504632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c35b-288c-4522-ae9f-d8dbe2e04bbd None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.504997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c35b-288c-4522-ae9f-d8dbe2e04bbd None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.506709 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 21/38] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:25.517766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:25.517976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39993-e524-4496-ad3d-7c28bfcf6b31 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.517976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39993-e524-4496-ad3d-7c28bfcf6b31 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.517976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39993-e524-4496-ad3d-7c28bfcf6b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.561067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-8ea39993-e524-4496-ad3d-7c28bfcf6b31 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:25.564071 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-8ea39993-e524-4496-ad3d-7c28bfcf6b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:25.566730 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:25.616114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d5141-91a8-4446-b86f-ff65c30e7ff0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:25.659454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9cb24-ed41-4f5d-bb56-89f9f7066e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:25.660288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9cb24-ed41-4f5d-bb56-89f9f7066e6f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.660586 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9cb24-ed41-4f5d-bb56-89f9f7066e6f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.660878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9cb24-ed41-4f5d-bb56-89f9f7066e6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.662826 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9cb24-ed41-4f5d-bb56-89f9f7066e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:25.664629 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9cb24-ed41-4f5d-bb56-89f9f7066e6f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:25.666474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 18/39] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:25.669815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 22/40] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:25.680644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9cb24-ed41-4f5d-bb56-89f9f7066e6f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:25.696345 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea39993-e524-4496-ad3d-7c28bfcf6b31 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:25.810416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9cb24-ed41-4f5d-bb56-89f9f7066e6f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:25.821961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea39993-e524-4496-ad3d-7c28bfcf6b31 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:25.825562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:25.847817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87948529-12fb-48ea-8a07-fffeb5a58be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:25.848698 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87948529-12fb-48ea-8a07-fffeb5a58be7 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.848989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87948529-12fb-48ea-8a07-fffeb5a58be7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.849274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87948529-12fb-48ea-8a07-fffeb5a58be7 None admin] PATH_INFO: `/v3/domains/default/users/082a7280c91e421382a44e080705c894/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.851326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87948529-12fb-48ea-8a07-fffeb5a58be7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=082a7280c91e421382a44e080705c894, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:25.852814 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87948529-12fb-48ea-8a07-fffeb5a58be7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:25.857460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b66a26-8023-4cb5-826e-555ce39b8839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:25.858379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b66a26-8023-4cb5-826e-555ce39b8839 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.858705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b66a26-8023-4cb5-826e-555ce39b8839 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.859219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b66a26-8023-4cb5-826e-555ce39b8839 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.860461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b66a26-8023-4cb5-826e-555ce39b8839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:25.862499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b66a26-8023-4cb5-826e-555ce39b8839 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:25.864559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 23/41] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:25.865770 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795570b-3593-4df3-be6f-517d81be0615 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.866065 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795570b-3593-4df3-be6f-517d81be0615 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.866350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795570b-3593-4df3-be6f-517d81be0615 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.867748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 24/42] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:25.869112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 19/43] 10.222.0.13 () {58 vars in 1361 bytes} [Wed May 25 13:35:25 2022] PUT /identity/v3/domains/default/users/082a7280c91e421382a44e080705c894/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:35:25.877990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d37f-cc07-43db-aa65-f79a23e40ca6 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:25.877990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d37f-cc07-43db-aa65-f79a23e40ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:25.877990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d37f-cc07-43db-aa65-f79a23e40ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:25.878249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795570b-3593-4df3-be6f-517d81be0615 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:25.884333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:25.897521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-0b87d37f-cc07-43db-aa65-f79a23e40ca6 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:25.899195 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-0b87d37f-cc07-43db-aa65-f79a23e40ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:25.988046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 20/44] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:26.002062 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795570b-3593-4df3-be6f-517d81be0615 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:26.013199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d37f-cc07-43db-aa65-f79a23e40ca6 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:26.043319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12652beb-ede1-4ea7-ba73-ef30a7a820f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:26.044057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652beb-ede1-4ea7-ba73-ef30a7a820f5 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:26.044349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652beb-ede1-4ea7-ba73-ef30a7a820f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:26.044568 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652beb-ede1-4ea7-ba73-ef30a7a820f5 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:26.045319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12652beb-ede1-4ea7-ba73-ef30a7a820f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:26.046891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12652beb-ede1-4ea7-ba73-ef30a7a820f5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:26.082920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 25/45] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:35:25 2022] POST /identity/v3/projects => generated 312 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:35:26.138817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d37f-cc07-43db-aa65-f79a23e40ca6 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:26.141923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:26.181009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692226f1-baa6-48ba-86de-e75aa2ea4966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:26.181714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692226f1-baa6-48ba-86de-e75aa2ea4966 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:26.182039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692226f1-baa6-48ba-86de-e75aa2ea4966 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:26.182331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692226f1-baa6-48ba-86de-e75aa2ea4966 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:26.183115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692226f1-baa6-48ba-86de-e75aa2ea4966 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:26.185147 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692226f1-baa6-48ba-86de-e75aa2ea4966 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:26.201131 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 21/46] 10.222.0.13 () {60 vars in 1131 bytes} [Wed May 25 13:35:26 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:28.116367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d859b-f046-4ca1-9434-eb3a2b6a4ee4 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.116866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d859b-f046-4ca1-9434-eb3a2b6a4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.116866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d859b-f046-4ca1-9434-eb3a2b6a4ee4 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.118275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 26/47] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:28.124228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e360-41ce-4068-8307-a2c1b7d333f4 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.124672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e360-41ce-4068-8307-a2c1b7d333f4 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.124794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e360-41ce-4068-8307-a2c1b7d333f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.146576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-f0b5e360-41ce-4068-8307-a2c1b7d333f4 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:28.147941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-f0b5e360-41ce-4068-8307-a2c1b7d333f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:28.223125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 22/48] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:28.247412 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d859b-f046-4ca1-9434-eb3a2b6a4ee4 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:28.310471 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:28.353701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d859b-f046-4ca1-9434-eb3a2b6a4ee4 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:28.361337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6acd5-8579-4408-be5a-c39f212e16a5 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.361639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6acd5-8579-4408-be5a-c39f212e16a5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.361960 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6acd5-8579-4408-be5a-c39f212e16a5 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.363356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 23/49] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:28.368661 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd5e1-a3ae-4608-8708-38b41262061a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.368901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd5e1-a3ae-4608-8708-38b41262061a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.369201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd5e1-a3ae-4608-8708-38b41262061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.385679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-ce3dd5e1-a3ae-4608-8708-38b41262061a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:28.386969 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ce3dd5e1-a3ae-4608-8708-38b41262061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:28.387930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6906f9e-0d83-4758-b934-9a5eee6d051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:28.388731 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6906f9e-0d83-4758-b934-9a5eee6d051d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.389026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6906f9e-0d83-4758-b934-9a5eee6d051d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.389309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6906f9e-0d83-4758-b934-9a5eee6d051d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.399463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6906f9e-0d83-4758-b934-9a5eee6d051d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-d6906f9e-0d83-4758-b934-9a5eee6d051d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:28.407667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:28.408621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:28.409559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 27/50] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:28.414667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6906f9e-0d83-4758-b934-9a5eee6d051d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:28.458292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 24/51] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:28.482933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dd5e1-a3ae-4608-8708-38b41262061a None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:28.507126 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:28.521481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6906f9e-0d83-4758-b934-9a5eee6d051d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:28.539256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:28.556650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:28.557336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.557627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.557942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.558696 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:28.559372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:28.560400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:28.572749 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 28/52] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:28.578912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:28.584552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dd5e1-a3ae-4608-8708-38b41262061a None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:28.619084 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f4b0-2568-4f64-963c-2bc94027f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:28.619801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f4b0-2568-4f64-963c-2bc94027f7ea None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.620094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f4b0-2568-4f64-963c-2bc94027f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.620380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f4b0-2568-4f64-963c-2bc94027f7ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.621644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37f4b0-2568-4f64-963c-2bc94027f7ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:28.623161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37f4b0-2568-4f64-963c-2bc94027f7ea None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:28.624808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 25/53] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:28.630344 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f4b0-2568-4f64-963c-2bc94027f7ea None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:28.680631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac87675-9e4b-4977-833d-d926286341dc None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:28.714712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0485-bc14-4ca2-a767-3ddde595bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:28.716145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0485-bc14-4ca2-a767-3ddde595bcee None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.716430 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0485-bc14-4ca2-a767-3ddde595bcee None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.716709 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0485-bc14-4ca2-a767-3ddde595bcee None admin] PATH_INFO: `/v3/users/082a7280c91e421382a44e080705c894` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.718201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f0485-bc14-4ca2-a767-3ddde595bcee None admin] RBAC: Authorizing `identity:get_user(user_id=082a7280c91e421382a44e080705c894)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:28.719658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f0485-bc14-4ca2-a767-3ddde595bcee None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:28.721303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 29/54] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:28 2022] GET /identity/v3/users/082a7280c91e421382a44e080705c894 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:28.722648 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:28.727191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0485-bc14-4ca2-a767-3ddde595bcee None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:28.732029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f4b0-2568-4f64-963c-2bc94027f7ea None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:28.766907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086fb6e-471a-4577-b903-da619e1d94ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:28.767579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086fb6e-471a-4577-b903-da619e1d94ea None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.767867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086fb6e-471a-4577-b903-da619e1d94ea None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.768148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086fb6e-471a-4577-b903-da619e1d94ea None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.768871 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086fb6e-471a-4577-b903-da619e1d94ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:28.770402 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086fb6e-471a-4577-b903-da619e1d94ea None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:28.775830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:28.804200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 26/55] 10.222.0.13 () {60 vars in 1140 bytes} [Wed May 25 13:35:28 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:35:28.836463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0485-bc14-4ca2-a767-3ddde595bcee None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:28.874098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3974e6-779b-4942-9143-ec9d61539fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:28.874823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3974e6-779b-4942-9143-ec9d61539fb8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:28.875110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3974e6-779b-4942-9143-ec9d61539fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:28.875392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3974e6-779b-4942-9143-ec9d61539fb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:28.876632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3974e6-779b-4942-9143-ec9d61539fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:28.878140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3974e6-779b-4942-9143-ec9d61539fb8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:28.879833 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 30/56] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:28.886010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086fb6e-471a-4577-b903-da619e1d94ea None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:28.995385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086fb6e-471a-4577-b903-da619e1d94ea None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:29.031271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9b983-bf73-41bf-b8e8-e07eccb372cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:29.031946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9b983-bf73-41bf-b8e8-e07eccb372cd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:29.032246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9b983-bf73-41bf-b8e8-e07eccb372cd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:29.032530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9b983-bf73-41bf-b8e8-e07eccb372cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:29.033383 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9b983-bf73-41bf-b8e8-e07eccb372cd None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.domain.id=default, user.id=082a7280c91e421382a44e080705c894) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:29.033704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9b983-bf73-41bf-b8e8-e07eccb372cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:29.035225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9b983-bf73-41bf-b8e8-e07eccb372cd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:29.041668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 27/57] 10.222.0.13 () {56 vars in 1322 bytes} [Wed May 25 13:35:28 2022] GET /identity/v3/role_assignments?user.id=082a7280c91e421382a44e080705c894&scope.domain.id=default&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:31.030020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d04af-0ed9-44b9-bcb6-c57a79c1aa3f None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:31.030555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d04af-0ed9-44b9-bcb6-c57a79c1aa3f None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:31.030644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d04af-0ed9-44b9-bcb6-c57a79c1aa3f None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:31.031956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 31/58] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:31.037189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c4964-451e-4274-a56b-0a1aa72d727f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:31.037619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c4964-451e-4274-a56b-0a1aa72d727f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:31.037784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c4964-451e-4274-a56b-0a1aa72d727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:31.054585 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-751c4964-451e-4274-a56b-0a1aa72d727f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:31.055715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-751c4964-451e-4274-a56b-0a1aa72d727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:31.057711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:31.123461 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 28/59] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:31.147688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d04af-0ed9-44b9-bcb6-c57a79c1aa3f None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:31.247835 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d04af-0ed9-44b9-bcb6-c57a79c1aa3f None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:31.263554 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:31.280882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf841aa-e2eb-4cad-89bd-7c31cebc81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:31.281668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf841aa-e2eb-4cad-89bd-7c31cebc81ec None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:31.281985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf841aa-e2eb-4cad-89bd-7c31cebc81ec None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:31.282266 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf841aa-e2eb-4cad-89bd-7c31cebc81ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:31.283432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf841aa-e2eb-4cad-89bd-7c31cebc81ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:31.284883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf841aa-e2eb-4cad-89bd-7c31cebc81ec None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:31.286543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 32/60] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:31.292014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c4964-451e-4274-a56b-0a1aa72d727f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:31.388168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c4964-451e-4274-a56b-0a1aa72d727f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:31.420908 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad3243-c036-4a18-84e3-3e19b987d131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:31.421623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad3243-c036-4a18-84e3-3e19b987d131 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:31.421944 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad3243-c036-4a18-84e3-3e19b987d131 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:31.422234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad3243-c036-4a18-84e3-3e19b987d131 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:31.422954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad3243-c036-4a18-84e3-3e19b987d131 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:31.424449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad3243-c036-4a18-84e3-3e19b987d131 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:31.437667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:31.450876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 29/61] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:35:31 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:34.719936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7b3f-ab9e-4744-a405-a96256dc5ae7 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:34.720802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7b3f-ab9e-4744-a405-a96256dc5ae7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:34.721229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7b3f-ab9e-4744-a405-a96256dc5ae7 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:34.723114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 33/62] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:34.728715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010c4a-2450-47f0-bd3f-9e6ce1c40fd2 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:34.729535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010c4a-2450-47f0-bd3f-9e6ce1c40fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:34.729990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010c4a-2450-47f0-bd3f-9e6ce1c40fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:34.752403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-19010c4a-2450-47f0-bd3f-9e6ce1c40fd2 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:34.753888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-19010c4a-2450-47f0-bd3f-9e6ce1c40fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:34.860588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 30/63] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:34.900472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7b3f-ab9e-4744-a405-a96256dc5ae7 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:35.050629 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7b3f-ab9e-4744-a405-a96256dc5ae7 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:35.100064 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9767c9-efc7-42bb-9fa2-d2c980696df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:35.100973 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9767c9-efc7-42bb-9fa2-d2c980696df9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.101173 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9767c9-efc7-42bb-9fa2-d2c980696df9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.101454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9767c9-efc7-42bb-9fa2-d2c980696df9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.122944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9767c9-efc7-42bb-9fa2-d2c980696df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-3a9767c9-efc7-42bb-9fa2-d2c980696df9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:35.130786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:35.131797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:35.132983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 34/64] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:35.133655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9b2b-dc09-4871-a915-f7c14aaf2c21 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.133992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9b2b-dc09-4871-a915-f7c14aaf2c21 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.135100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9b2b-dc09-4871-a915-f7c14aaf2c21 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.135854 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 31/65] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:35.141619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9767c9-efc7-42bb-9fa2-d2c980696df9 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:35.142662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffdda1-ba73-459f-8957-ef2ff9195ed3 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.143166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffdda1-ba73-459f-8957-ef2ff9195ed3 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.143654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffdda1-ba73-459f-8957-ef2ff9195ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.162913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-faffdda1-ba73-459f-8957-ef2ff9195ed3 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:35.164623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-faffdda1-ba73-459f-8957-ef2ff9195ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:35.195159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:35.248197 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 32/66] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:35.250316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef22-656b-454b-9a7b-cb4158d92f8c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.250920 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef22-656b-454b-9a7b-cb4158d92f8c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.251417 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef22-656b-454b-9a7b-cb4158d92f8c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.253466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 33/67] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:35.259838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b79e7-d3c2-4254-8fdf-7509afb09272 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.260480 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b79e7-d3c2-4254-8fdf-7509afb09272 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.261000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b79e7-d3c2-4254-8fdf-7509afb09272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.273551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9767c9-efc7-42bb-9fa2-d2c980696df9 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:35.282827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-cd9b79e7-d3c2-4254-8fdf-7509afb09272 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:35.284367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-cd9b79e7-d3c2-4254-8fdf-7509afb09272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:35.322586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:35.323891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.324401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.324866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.326136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:35.327130 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:35.329151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:35.347987 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 35/68] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:35.349160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:35.360820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:35.384078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 34/69] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:35.385344 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b79e7-d3c2-4254-8fdf-7509afb09272 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:35.482843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09f37-7d93-4fc2-833b-a6758fdebce6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:35.491254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:35.497054 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b79e7-d3c2-4254-8fdf-7509afb09272 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:35.522853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e498b-dba7-4f98-b0c4-ea5362f90691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:35.523663 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e498b-dba7-4f98-b0c4-ea5362f90691 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.523955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e498b-dba7-4f98-b0c4-ea5362f90691 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.524236 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e498b-dba7-4f98-b0c4-ea5362f90691 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.531882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e933c-179f-4063-b57f-da23a764e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:35.532782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e933c-179f-4063-b57f-da23a764e286 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.533259 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e933c-179f-4063-b57f-da23a764e286 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.533550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e933c-179f-4063-b57f-da23a764e286 None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.534526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e498b-dba7-4f98-b0c4-ea5362f90691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4c8e498b-dba7-4f98-b0c4-ea5362f90691 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:35.542588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:35.544030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:35.544805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:35:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:35.545441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e498b-dba7-4f98-b0c4-ea5362f90691 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:35.552804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e933c-179f-4063-b57f-da23a764e286 None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:35.554387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e933c-179f-4063-b57f-da23a764e286 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:35.556141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:35 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:35.557491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f8473-570a-43a6-b9f1-25c9ad781f18 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.557815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f8473-570a-43a6-b9f1-25c9ad781f18 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.558104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f8473-570a-43a6-b9f1-25c9ad781f18 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.560050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 36/72] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:35.561349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d00da6-865d-4bf0-b77b-0f9ba7906e24 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.561659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d00da6-865d-4bf0-b77b-0f9ba7906e24 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.561983 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d00da6-865d-4bf0-b77b-0f9ba7906e24 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.563326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 37/73] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:35.564200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d00da6-865d-4bf0-b77b-0f9ba7906e24 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:35.610025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:35.655869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e498b-dba7-4f98-b0c4-ea5362f90691 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:35.669882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d00da6-865d-4bf0-b77b-0f9ba7906e24 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:35.689803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06e1a-f177-49c0-8667-3bd2deb903ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:35.690603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06e1a-f177-49c0-8667-3bd2deb903ed None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.690894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06e1a-f177-49c0-8667-3bd2deb903ed None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.691168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06e1a-f177-49c0-8667-3bd2deb903ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.701184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06e1a-f177-49c0-8667-3bd2deb903ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:35.703306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1145788-b6eb-4a61-a273-269972d06393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:35.704013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145788-b6eb-4a61-a273-269972d06393 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.704307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145788-b6eb-4a61-a273-269972d06393 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.704596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145788-b6eb-4a61-a273-269972d06393 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.705360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1145788-b6eb-4a61-a273-269972d06393 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:35.705678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1145788-b6eb-4a61-a273-269972d06393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:35.707246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1145788-b6eb-4a61-a273-269972d06393 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-22a06e1a-f177-49c0-8667-3bd2deb903ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:35.708747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:35.709571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:35.710651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:35.711291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06e1a-f177-49c0-8667-3bd2deb903ed None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:35.719949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:35:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:35.721201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a73b8-aa3e-4588-8a8c-730ea98c01bb None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.721495 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a73b8-aa3e-4588-8a8c-730ea98c01bb None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.721904 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a73b8-aa3e-4588-8a8c-730ea98c01bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.738624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-a38a73b8-aa3e-4588-8a8c-730ea98c01bb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:35.739819 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a38a73b8-aa3e-4588-8a8c-730ea98c01bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:35.744523 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:35.806839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:35.808146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a36d7-f93c-4dc5-b624-b083cc719689 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.808446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a36d7-f93c-4dc5-b624-b083cc719689 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.809059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a36d7-f93c-4dc5-b624-b083cc719689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.822747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06e1a-f177-49c0-8667-3bd2deb903ed None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:35.825650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-319a36d7-f93c-4dc5-b624-b083cc719689 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:35.826907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-319a36d7-f93c-4dc5-b624-b083cc719689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:35.857448 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:35.857639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fc0a1-0bc2-4538-b634-935b8f04526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:35.858276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc0a1-0bc2-4538-b634-935b8f04526a None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:35.858564 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc0a1-0bc2-4538-b634-935b8f04526a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:35.858861 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc0a1-0bc2-4538-b634-935b8f04526a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:35.919166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 40/77] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:35.919913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a36d7-f93c-4dc5-b624-b083cc719689 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:35.929827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fc0a1-0bc2-4538-b634-935b8f04526a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:35.931992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fc0a1-0bc2-4538-b634-935b8f04526a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:35.960588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:36.020957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a36d7-f93c-4dc5-b624-b083cc719689 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.035017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 38/78] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:36.035884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fc0a1-0bc2-4538-b634-935b8f04526a None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.058841 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.059527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.059818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.060101 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.060863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:36.061176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.062634 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.071069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 41/79] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:36.071892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.099757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:36.146240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fc0a1-0bc2-4538-b634-935b8f04526a None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.172497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:36.178165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58c7b-a464-40a2-8e6a-42c8bed8e241 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.182503 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ed5ba-dc44-4a0c-a51e-4cce9c63157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.183393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ed5ba-dc44-4a0c-a51e-4cce9c63157c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.183718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ed5ba-dc44-4a0c-a51e-4cce9c63157c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.184005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ed5ba-dc44-4a0c-a51e-4cce9c63157c None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.185634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ed5ba-dc44-4a0c-a51e-4cce9c63157c None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.187528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ed5ba-dc44-4a0c-a51e-4cce9c63157c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.189536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 39/80] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:36.190425 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ed5ba-dc44-4a0c-a51e-4cce9c63157c None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.214487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9cb9-b61f-497e-8b74-8527907ac499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.215867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9cb9-b61f-497e-8b74-8527907ac499 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.216161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9cb9-b61f-497e-8b74-8527907ac499 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.216914 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9cb9-b61f-497e-8b74-8527907ac499 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.218461 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b9cb9-b61f-497e-8b74-8527907ac499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.220434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b9cb9-b61f-497e-8b74-8527907ac499 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.222719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 42/81] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:36.223423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9cb9-b61f-497e-8b74-8527907ac499 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.296933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ed5ba-dc44-4a0c-a51e-4cce9c63157c None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.316266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:36.323315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9cb9-b61f-497e-8b74-8527907ac499 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.330758 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb397bf-def4-4408-8ec4-b3340f74dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.331560 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb397bf-def4-4408-8ec4-b3340f74dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.331852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb397bf-def4-4408-8ec4-b3340f74dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.332133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb397bf-def4-4408-8ec4-b3340f74dbe9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.343303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb397bf-def4-4408-8ec4-b3340f74dbe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-3fb397bf-def4-4408-8ec4-b3340f74dbe9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:36.350952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:36.351834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:36.352609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 40/82] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:36.353242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb397bf-def4-4408-8ec4-b3340f74dbe9 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.366943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb77b4-96ab-4005-9b3d-758e9bad872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.367823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb77b4-96ab-4005-9b3d-758e9bad872e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.368111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb77b4-96ab-4005-9b3d-758e9bad872e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.368392 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb77b4-96ab-4005-9b3d-758e9bad872e None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.369665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb77b4-96ab-4005-9b3d-758e9bad872e None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.371245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb77b4-96ab-4005-9b3d-758e9bad872e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.372982 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 43/83] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:36.373779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb77b4-96ab-4005-9b3d-758e9bad872e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.409804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:36.457496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb397bf-def4-4408-8ec4-b3340f74dbe9 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.477752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb77b4-96ab-4005-9b3d-758e9bad872e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.490710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a493-45bb-4f4f-9882-9331e38d8e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.491585 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a493-45bb-4f4f-9882-9331e38d8e3f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.491872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a493-45bb-4f4f-9882-9331e38d8e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.492152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a493-45bb-4f4f-9882-9331e38d8e3f None admin] PATH_INFO: `/v3/users/082a7280c91e421382a44e080705c894` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.493361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a493-45bb-4f4f-9882-9331e38d8e3f None admin] RBAC: Authorizing `identity:get_user(user_id=082a7280c91e421382a44e080705c894)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.494847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a493-45bb-4f4f-9882-9331e38d8e3f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.496984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 41/84] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/users/082a7280c91e421382a44e080705c894 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:36.497790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a493-45bb-4f4f-9882-9331e38d8e3f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.516401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da4c1d-87a6-448d-ad1f-fa4c3c3769cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.517070 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4c1d-87a6-448d-ad1f-fa4c3c3769cf None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.517367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4c1d-87a6-448d-ad1f-fa4c3c3769cf None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.517653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4c1d-87a6-448d-ad1f-fa4c3c3769cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.547482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:36.587672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da4c1d-87a6-448d-ad1f-fa4c3c3769cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.589188 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da4c1d-87a6-448d-ad1f-fa4c3c3769cf None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.609482 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a493-45bb-4f4f-9882-9331e38d8e3f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.632691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:36.645419 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5218af-b551-4e04-b0f8-b5cad49e9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.646138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5218af-b551-4e04-b0f8-b5cad49e9250 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.646434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5218af-b551-4e04-b0f8-b5cad49e9250 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.646723 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5218af-b551-4e04-b0f8-b5cad49e9250 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.647451 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5218af-b551-4e04-b0f8-b5cad49e9250 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.648933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5218af-b551-4e04-b0f8-b5cad49e9250 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.675879 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 42/85] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:35:36 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:36.676735 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5218af-b551-4e04-b0f8-b5cad49e9250 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.700975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 44/86] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:36.700975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da4c1d-87a6-448d-ad1f-fa4c3c3769cf None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.770367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:36.806313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5218af-b551-4e04-b0f8-b5cad49e9250 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.819890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da4c1d-87a6-448d-ad1f-fa4c3c3769cf None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:36.853778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.854476 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.854768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.855051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.856330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] RBAC: Adding query filter params (name=member) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:36.856645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.858112 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.861703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:36.862659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:36.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:36.863527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:36.864679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] RBAC: Adding query filter params (role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=37e3413dfe4e45d486e2cfee347f9856, user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:36.865157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:36.866685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:36.872831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 43/87] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:36.872831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.881911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 45/88] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/role_assignments?user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:36.882882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:36.929654 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:37.040544 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3eee-328d-4061-bb74-6eb9f7c2f8aa None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:37.048234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de7bf4-50e6-4ca4-a886-9c2ba5a613df None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:37.094567 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:37.097915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d80e-585e-43f3-b247-176fe4246c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:37.098681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d80e-585e-43f3-b247-176fe4246c04 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:37.099372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d80e-585e-43f3-b247-176fe4246c04 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:37.099685 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d80e-585e-43f3-b247-176fe4246c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:37.112910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5e9f5-666a-49f5-a0cd-3438c0f6dfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:37.113919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5e9f5-666a-49f5-a0cd-3438c0f6dfd5 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:37.114128 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5e9f5-666a-49f5-a0cd-3438c0f6dfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:37.114413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5e9f5-666a-49f5-a0cd-3438c0f6dfd5 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:37.116067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5e9f5-666a-49f5-a0cd-3438c0f6dfd5 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:37.117563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5e9f5-666a-49f5-a0cd-3438c0f6dfd5 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:37.119370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 46/89] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:37.122135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5e9f5-666a-49f5-a0cd-3438c0f6dfd5 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:37.200528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76d80e-585e-43f3-b247-176fe4246c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:37.202053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76d80e-585e-43f3-b247-176fe4246c04 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:37.287921 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:37.310511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5e9f5-666a-49f5-a0cd-3438c0f6dfd5 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:37.353995 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 44/90] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:37.355095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d80e-585e-43f3-b247-176fe4246c04 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:37.387737 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80305b3-85f5-4550-aa48-b52480bb2b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:37.388718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80305b3-85f5-4550-aa48-b52480bb2b4d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:37.389012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80305b3-85f5-4550-aa48-b52480bb2b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:37.389297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80305b3-85f5-4550-aa48-b52480bb2b4d None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:37.394551 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80305b3-85f5-4550-aa48-b52480bb2b4d None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:37.396062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80305b3-85f5-4550-aa48-b52480bb2b4d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:37.398228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 47/91] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:37 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:37.399040 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80305b3-85f5-4550-aa48-b52480bb2b4d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:37.518836 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d80e-585e-43f3-b247-176fe4246c04 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:37.541930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:37.573256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:37.573893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:37.574710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:37.575006 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:37.575863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] RBAC: Adding query filter params (role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=37e3413dfe4e45d486e2cfee347f9856, user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:37.576185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:37.578006 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:37.599135 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 45/92] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:37 2022] GET /identity/v3/role_assignments?user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:37.600026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:37.609032 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:37.626175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80305b3-85f5-4550-aa48-b52480bb2b4d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:37.694605 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28e19f-bf01-4abc-8a01-fc02216cb1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:37.695484 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e19f-bf01-4abc-8a01-fc02216cb1f7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:37.695774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e19f-bf01-4abc-8a01-fc02216cb1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:37.696056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e19f-bf01-4abc-8a01-fc02216cb1f7 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:37.697510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28e19f-bf01-4abc-8a01-fc02216cb1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:37.699063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28e19f-bf01-4abc-8a01-fc02216cb1f7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:37.701399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 48/93] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:37 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:37.707387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28e19f-bf01-4abc-8a01-fc02216cb1f7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:37.831238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633db8d3-4463-4bfe-ac9f-46b8741d4901 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:37.896245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a811b-22d8-416d-ac5c-865d8f53db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:37.896949 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a811b-22d8-416d-ac5c-865d8f53db83 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:37.897243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a811b-22d8-416d-ac5c-865d8f53db83 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:37.897529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a811b-22d8-416d-ac5c-865d8f53db83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:37.944270 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28e19f-bf01-4abc-8a01-fc02216cb1f7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:38.007242 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:38.019703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a811b-22d8-416d-ac5c-865d8f53db83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:38.021691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a811b-22d8-416d-ac5c-865d8f53db83 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:38.025112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:38.025867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:38.026155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:38.026437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:38.027286 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=37e3413dfe4e45d486e2cfee347f9856, user.id=082a7280c91e421382a44e080705c894) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:38.027647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:38.029323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:38.030701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:38.041707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 49/94] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:37 2022] GET /identity/v3/role_assignments?user.id=082a7280c91e421382a44e080705c894&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:38.189348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 46/95] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:38.195427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:38.325081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01bd1-0cb0-49c0-80bc-7296bce03075 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:38.360694 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601fb54-9efc-4f49-8fe8-9b1fa2107762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:38.361606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601fb54-9efc-4f49-8fe8-9b1fa2107762 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:38.361930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601fb54-9efc-4f49-8fe8-9b1fa2107762 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:38.362218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601fb54-9efc-4f49-8fe8-9b1fa2107762 None admin] PATH_INFO: `/v3/projects/f357607b080244fd94edad08e8349deb` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:38.363597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601fb54-9efc-4f49-8fe8-9b1fa2107762 None admin] RBAC: Authorizing `identity:get_project(project_id=f357607b080244fd94edad08e8349deb)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:38.365153 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601fb54-9efc-4f49-8fe8-9b1fa2107762 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:38.367257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 50/96] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:38 2022] GET /identity/v3/projects/f357607b080244fd94edad08e8349deb => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:38.374051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a811b-22d8-416d-ac5c-865d8f53db83 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:38.509927 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a811b-22d8-416d-ac5c-865d8f53db83 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:38.520816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:38.567142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684f98f-590c-4091-ad5c-fbb5ede66846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:38.567820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f98f-590c-4091-ad5c-fbb5ede66846 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:38.568115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f98f-590c-4091-ad5c-fbb5ede66846 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:38.568401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f98f-590c-4091-ad5c-fbb5ede66846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:38.569264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684f98f-590c-4091-ad5c-fbb5ede66846 None admin] RBAC: Adding query filter params (role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=f357607b080244fd94edad08e8349deb, user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:38.569588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684f98f-590c-4091-ad5c-fbb5ede66846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:38.571127 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684f98f-590c-4091-ad5c-fbb5ede66846 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:38.581768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 47/97] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:38 2022] GET /identity/v3/role_assignments?user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0&scope.project.id=f357607b080244fd94edad08e8349deb&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:39.745431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e26c00-b753-41ba-a7b0-98cbd380f213 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:39.747016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e26c00-b753-41ba-a7b0-98cbd380f213 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:39.747531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e26c00-b753-41ba-a7b0-98cbd380f213 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:39.749165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 51/98] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:39.754782 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222490-a5e8-4e7d-9467-fb9241e01955 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:39.755681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222490-a5e8-4e7d-9467-fb9241e01955 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:39.756163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222490-a5e8-4e7d-9467-fb9241e01955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:39.778766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-20222490-a5e8-4e7d-9467-fb9241e01955 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:39.780338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-20222490-a5e8-4e7d-9467-fb9241e01955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:39.870351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 48/99] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:39.922703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e26c00-b753-41ba-a7b0-98cbd380f213 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:39.998987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:40.040349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e26c00-b753-41ba-a7b0-98cbd380f213 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:40.077157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517527c3-549f-4a5d-90e4-666a8b90bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:40.078057 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517527c3-549f-4a5d-90e4-666a8b90bbbe None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:40.078347 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517527c3-549f-4a5d-90e4-666a8b90bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:40.078719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517527c3-549f-4a5d-90e4-666a8b90bbbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:40.079963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517527c3-549f-4a5d-90e4-666a8b90bbbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:40.081453 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517527c3-549f-4a5d-90e4-666a8b90bbbe None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:40.083218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 52/100] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:40.091307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20222490-a5e8-4e7d-9467-fb9241e01955 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:40.227375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:40.232715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20222490-a5e8-4e7d-9467-fb9241e01955 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:40.273335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92558a8-79cc-4a57-9b3e-2e9391dac8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:40.273960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92558a8-79cc-4a57-9b3e-2e9391dac8eb None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:40.274255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92558a8-79cc-4a57-9b3e-2e9391dac8eb None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:40.274540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92558a8-79cc-4a57-9b3e-2e9391dac8eb None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:40.275281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92558a8-79cc-4a57-9b3e-2e9391dac8eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:40.276812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92558a8-79cc-4a57-9b3e-2e9391dac8eb None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:40.319704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 49/101] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:35:40 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:40.452654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d5399-f3dd-4a2a-a546-c0cb5b146c8a None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:40.452654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d5399-f3dd-4a2a-a546-c0cb5b146c8a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:40.452654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d5399-f3dd-4a2a-a546-c0cb5b146c8a None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:40.452654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 53/102] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:40.459260 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfa36c-14fc-468a-8055-0a40027e5ea3 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:40.459885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfa36c-14fc-468a-8055-0a40027e5ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:40.460619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfa36c-14fc-468a-8055-0a40027e5ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:40.482465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-18bfa36c-14fc-468a-8055-0a40027e5ea3 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:40.484089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-18bfa36c-14fc-468a-8055-0a40027e5ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:40.487580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559fbd-5d18-428d-aea1-0b4e9a4d3f1b None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:40.488168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559fbd-5d18-428d-aea1-0b4e9a4d3f1b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:40.488643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559fbd-5d18-428d-aea1-0b4e9a4d3f1b None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:40.490495 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 54/103] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:40.496760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b411f75-1da8-497e-b66e-16645fd7da8d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:40.497379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b411f75-1da8-497e-b66e-16645fd7da8d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:40.497890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b411f75-1da8-497e-b66e-16645fd7da8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:40.534745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-1b411f75-1da8-497e-b66e-16645fd7da8d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:40.537155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1b411f75-1da8-497e-b66e-16645fd7da8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:40.625668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 50/104] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:40.657847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfa36c-14fc-468a-8055-0a40027e5ea3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:40.699720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 55/105] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 25 13:35:40.746966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b411f75-1da8-497e-b66e-16645fd7da8d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:40.764349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:40.800714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfa36c-14fc-468a-8055-0a40027e5ea3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:40.840399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:40.885178 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b411f75-1da8-497e-b66e-16645fd7da8d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:40.915023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444823-0f9e-44ec-8b86-b4fab2cdae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:40.916119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444823-0f9e-44ec-8b86-b4fab2cdae13 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:40.916558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444823-0f9e-44ec-8b86-b4fab2cdae13 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:40.917019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444823-0f9e-44ec-8b86-b4fab2cdae13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:40.941498 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f444823-0f9e-44ec-8b86-b4fab2cdae13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-6f444823-0f9e-44ec-8b86-b4fab2cdae13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:40.950201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:40.951390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:40.952384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:40.958391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e89d31-77c1-41b7-8d44-c90d9a779a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:40.959493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e89d31-77c1-41b7-8d44-c90d9a779a58 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:40.959938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e89d31-77c1-41b7-8d44-c90d9a779a58 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:40.960610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e89d31-77c1-41b7-8d44-c90d9a779a58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:40.967763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 51/106] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:35:40.968970 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444823-0f9e-44ec-8b86-b4fab2cdae13 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:40.986371 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e89d31-77c1-41b7-8d44-c90d9a779a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-57e89d31-77c1-41b7-8d44-c90d9a779a58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:40.999875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:41.001034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:41.002076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 56/107] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:41.009418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e89d31-77c1-41b7-8d44-c90d9a779a58 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:41.114356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444823-0f9e-44ec-8b86-b4fab2cdae13 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:41.156417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e75be5-6248-47f4-b5dd-fa8c72a86938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:41.157469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75be5-6248-47f4-b5dd-fa8c72a86938 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.158170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75be5-6248-47f4-b5dd-fa8c72a86938 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.158658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75be5-6248-47f4-b5dd-fa8c72a86938 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.159930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e75be5-6248-47f4-b5dd-fa8c72a86938 None admin] RBAC: Adding query filter params (name=member) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:41.160468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e75be5-6248-47f4-b5dd-fa8c72a86938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:41.162673 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e75be5-6248-47f4-b5dd-fa8c72a86938 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:41.175983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 52/108] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:41.177165 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63660d-fa4b-467d-bd1c-b92b33711915 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.177463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63660d-fa4b-467d-bd1c-b92b33711915 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.181797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63660d-fa4b-467d-bd1c-b92b33711915 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.181797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 53/109] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:41.185358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c354-2325-42bd-94ae-698ef2c6836d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.185669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c354-2325-42bd-94ae-698ef2c6836d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.185989 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c354-2325-42bd-94ae-698ef2c6836d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.191243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:41.205124 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-8b86c354-2325-42bd-94ae-698ef2c6836d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:41.206391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-8b86c354-2325-42bd-94ae-698ef2c6836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:41.238420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e89d31-77c1-41b7-8d44-c90d9a779a58 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:41.267413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:41.282277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 54/110] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:41.283279 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86c354-2325-42bd-94ae-698ef2c6836d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:41.286207 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287b0ad-dc23-4b57-b792-098f5090f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:41.287061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287b0ad-dc23-4b57-b792-098f5090f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.287477 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287b0ad-dc23-4b57-b792-098f5090f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.287880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287b0ad-dc23-4b57-b792-098f5090f9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.288758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287b0ad-dc23-4b57-b792-098f5090f9a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:41.289214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287b0ad-dc23-4b57-b792-098f5090f9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:41.290800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287b0ad-dc23-4b57-b792-098f5090f9a2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:41.303395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 57/111] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:41.304975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf51e4-13f9-4792-ac1e-cfafdcfcd7d8 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.305418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf51e4-13f9-4792-ac1e-cfafdcfcd7d8 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.306473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf51e4-13f9-4792-ac1e-cfafdcfcd7d8 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.308602 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 58/112] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:41.310341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf51e4-13f9-4792-ac1e-cfafdcfcd7d8 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:41.426038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86c354-2325-42bd-94ae-698ef2c6836d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:41.439679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf51e4-13f9-4792-ac1e-cfafdcfcd7d8 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:41.468503 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:41.475988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da89c-07e1-4532-b799-c2e262605848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:41.477340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da89c-07e1-4532-b799-c2e262605848 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.477906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da89c-07e1-4532-b799-c2e262605848 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.478435 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da89c-07e1-4532-b799-c2e262605848 None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.479951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3da89c-07e1-4532-b799-c2e262605848 None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:41.482471 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3da89c-07e1-4532-b799-c2e262605848 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:41.484856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 55/113] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:41 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:41.486523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fa98-2869-4c5d-b70e-3b097b85ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:41.486861 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd37c7-3c8c-4c71-9d67-c8b348a77670 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.487382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd37c7-3c8c-4c71-9d67-c8b348a77670 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.487482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fa98-2869-4c5d-b70e-3b097b85ebaa None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.487774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fa98-2869-4c5d-b70e-3b097b85ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.488059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fa98-2869-4c5d-b70e-3b097b85ebaa None admin] PATH_INFO: `/v3/users/fb9d3c589eb04062be138959be0fc22c` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.488408 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd37c7-3c8c-4c71-9d67-c8b348a77670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.503692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0fa98-2869-4c5d-b70e-3b097b85ebaa None admin] RBAC: Authorizing `identity:get_user(user_id=fb9d3c589eb04062be138959be0fc22c)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:41.505209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0fa98-2869-4c5d-b70e-3b097b85ebaa None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:41.507187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 59/114] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:41 2022] GET /identity/v3/users/fb9d3c589eb04062be138959be0fc22c => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:41.508091 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fa98-2869-4c5d-b70e-3b097b85ebaa None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:41.508676 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-21fd37c7-3c8c-4c71-9d67-c8b348a77670 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:41.510121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-21fd37c7-3c8c-4c71-9d67-c8b348a77670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:41.557835 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:41.584267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 56/115] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:41.585723 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd37c7-3c8c-4c71-9d67-c8b348a77670 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:41.621916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fa98-2869-4c5d-b70e-3b097b85ebaa None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:41.667176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1d427-6ce3-45fa-9415-4422a40c787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:41.668631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1d427-6ce3-45fa-9415-4422a40c787f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.668936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1d427-6ce3-45fa-9415-4422a40c787f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.669221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1d427-6ce3-45fa-9415-4422a40c787f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.682251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1d427-6ce3-45fa-9415-4422a40c787f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-7ec1d427-6ce3-45fa-9415-4422a40c787f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:41.691248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:41.692295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:41.693081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 60/116] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:35:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:41.698669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1d427-6ce3-45fa-9415-4422a40c787f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:41.705213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd37c7-3c8c-4c71-9d67-c8b348a77670 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:41.737617 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:41.745117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e05062-fd35-427b-ab22-0fd0fcb2a2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:41.746179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05062-fd35-427b-ab22-0fd0fcb2a2d7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.746473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05062-fd35-427b-ab22-0fd0fcb2a2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.746756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05062-fd35-427b-ab22-0fd0fcb2a2d7 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.747993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e05062-fd35-427b-ab22-0fd0fcb2a2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:41.749637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e05062-fd35-427b-ab22-0fd0fcb2a2d7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:41.751917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 57/117] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:41 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:41.752808 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e05062-fd35-427b-ab22-0fd0fcb2a2d7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:41.822021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:41.826035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1d427-6ce3-45fa-9415-4422a40c787f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:41.864175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1eb7f-00d3-43bd-9754-26ccac7c2f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:41.865243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1eb7f-00d3-43bd-9754-26ccac7c2f05 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.865873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1eb7f-00d3-43bd-9754-26ccac7c2f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.866379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1eb7f-00d3-43bd-9754-26ccac7c2f05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.878659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e05062-fd35-427b-ab22-0fd0fcb2a2d7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:41.915753 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380f1b4-c897-4e04-a90a-be5baf4e9962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:41.916663 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380f1b4-c897-4e04-a90a-be5baf4e9962 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:41.917034 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380f1b4-c897-4e04-a90a-be5baf4e9962 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:41.917321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380f1b4-c897-4e04-a90a-be5baf4e9962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:41.929001 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380f1b4-c897-4e04-a90a-be5baf4e9962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-2380f1b4-c897-4e04-a90a-be5baf4e9962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:41.937326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:41.938732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 58/118] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:41.939747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380f1b4-c897-4e04-a90a-be5baf4e9962 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:41.943861 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1eb7f-00d3-43bd-9754-26ccac7c2f05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:41.945390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1eb7f-00d3-43bd-9754-26ccac7c2f05 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.003626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:42.049429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:42.051220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380f1b4-c897-4e04-a90a-be5baf4e9962 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:42.059574 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 61/119] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:42.060493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1eb7f-00d3-43bd-9754-26ccac7c2f05 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:42.089109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4914-c5ff-4708-8650-8f5f3745a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:42.090366 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4914-c5ff-4708-8650-8f5f3745a217 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.090716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4914-c5ff-4708-8650-8f5f3745a217 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.091008 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4914-c5ff-4708-8650-8f5f3745a217 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.091806 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4914-c5ff-4708-8650-8f5f3745a217 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:42.092127 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4914-c5ff-4708-8650-8f5f3745a217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:42.093528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4914-c5ff-4708-8650-8f5f3745a217 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.102056 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 59/120] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:35:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:42.103380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d3c1-ed43-433b-afa3-a221cd0bb208 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.103684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d3c1-ed43-433b-afa3-a221cd0bb208 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.103977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d3c1-ed43-433b-afa3-a221cd0bb208 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.109382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 60/121] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:42.109382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d3c1-ed43-433b-afa3-a221cd0bb208 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:42.186171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1eb7f-00d3-43bd-9754-26ccac7c2f05 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:42.226235 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d3c1-ed43-433b-afa3-a221cd0bb208 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:42.230724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df100d9-191a-4cfd-bac4-40a3f94a4dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:42.231641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df100d9-191a-4cfd-bac4-40a3f94a4dcd None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.231936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df100d9-191a-4cfd-bac4-40a3f94a4dcd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.232221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df100d9-191a-4cfd-bac4-40a3f94a4dcd None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856/users/4cbdfb14b73a4a4d85d4cad1d9888bb0/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.234337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df100d9-191a-4cfd-bac4-40a3f94a4dcd None admin] RBAC: Authorizing `identity:create_grant(project_id=37e3413dfe4e45d486e2cfee347f9856, user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:42.235855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df100d9-191a-4cfd-bac4-40a3f94a4dcd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.250493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:42.253805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 62/122] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:35:42 2022] PUT /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856/users/4cbdfb14b73a4a4d85d4cad1d9888bb0/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:35:42.253805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df100d9-191a-4cfd-bac4-40a3f94a4dcd None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:42.290994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:42.292334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.292842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.293301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.299063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:42.299394 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:42.300873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.318369 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 61/123] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:42.320921 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:42.337474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:42.389293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df100d9-191a-4cfd-bac4-40a3f94a4dcd None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:42.431855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ea204-3787-49a4-86a3-d6896ceb1b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:42.433096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea204-3787-49a4-86a3-d6896ceb1b09 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.433096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea204-3787-49a4-86a3-d6896ceb1b09 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.433369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea204-3787-49a4-86a3-d6896ceb1b09 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.435277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea204-3787-49a4-86a3-d6896ceb1b09 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:42.436807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea204-3787-49a4-86a3-d6896ceb1b09 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.438919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 63/124] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:42 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:42.445288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d58c4-5e2c-4579-a7c5-0b3bcbea99d5 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.445607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d58c4-5e2c-4579-a7c5-0b3bcbea99d5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.445911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d58c4-5e2c-4579-a7c5-0b3bcbea99d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.467925 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b85d58c4-5e2c-4579-a7c5-0b3bcbea99d5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:42.469267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b85d58c4-5e2c-4579-a7c5-0b3bcbea99d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:42.475383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2a31e-8b21-4cf0-98a7-05bee06993e4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:42.519743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f542-6ae9-4929-abd3-696014840ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:42.520557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f542-6ae9-4929-abd3-696014840ea6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.520853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f542-6ae9-4929-abd3-696014840ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.521138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f542-6ae9-4929-abd3-696014840ea6 None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.522981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016f542-6ae9-4929-abd3-696014840ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:42.524469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016f542-6ae9-4929-abd3-696014840ea6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.526216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 62/125] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:42 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:42.527080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f542-6ae9-4929-abd3-696014840ea6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:42.579121 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 64/126] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:42.580216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d58c4-5e2c-4579-a7c5-0b3bcbea99d5 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:42.591496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:42.661566 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f542-6ae9-4929-abd3-696014840ea6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:42.672480 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:42.704355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd252743-ccde-4ab3-9ba0-8a7a017b78a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:42.705097 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd252743-ccde-4ab3-9ba0-8a7a017b78a6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.705528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd252743-ccde-4ab3-9ba0-8a7a017b78a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.705745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd252743-ccde-4ab3-9ba0-8a7a017b78a6 None admin] PATH_INFO: `/v3/users/082a7280c91e421382a44e080705c894` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.707006 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd252743-ccde-4ab3-9ba0-8a7a017b78a6 None admin] RBAC: Authorizing `identity:get_user(user_id=082a7280c91e421382a44e080705c894)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:42.708476 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd252743-ccde-4ab3-9ba0-8a7a017b78a6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.710509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 63/127] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:42 2022] GET /identity/v3/users/082a7280c91e421382a44e080705c894 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:42.715037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd252743-ccde-4ab3-9ba0-8a7a017b78a6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:42.736084 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d58c4-5e2c-4579-a7c5-0b3bcbea99d5 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:42.774646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:42.775357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.775592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.775883 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.776753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] RBAC: Adding query filter params (role.id=acb61715c6f849fca1c8d329abea7b1d, scope.project.id=37e3413dfe4e45d486e2cfee347f9856, user.id=fb9d3c589eb04062be138959be0fc22c) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:42.777050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:42.778641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.788198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 65/128] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:42 2022] GET /identity/v3/role_assignments?user.id=fb9d3c589eb04062be138959be0fc22c&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=acb61715c6f849fca1c8d329abea7b1d => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:42.789064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:42.860696 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd252743-ccde-4ab3-9ba0-8a7a017b78a6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:42.883634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:42.903818 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7911f-03ee-4240-9161-b802da7e1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:42.904799 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7911f-03ee-4240-9161-b802da7e1e83 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:42.905085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7911f-03ee-4240-9161-b802da7e1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:42.905362 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7911f-03ee-4240-9161-b802da7e1e83 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:42.906951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7911f-03ee-4240-9161-b802da7e1e83 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:42.908459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7911f-03ee-4240-9161-b802da7e1e83 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:42.910349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 64/129] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:42 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:42.911185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7911f-03ee-4240-9161-b802da7e1e83 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:43.028221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7911f-03ee-4240-9161-b802da7e1e83 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:43.059074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c3ad-2e3a-4ca9-9994-fda08b874ad4 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:43.077396 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7adc8-38f8-4e14-b692-254a4f83ced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:43.078058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7adc8-38f8-4e14-b692-254a4f83ced7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:43.078348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7adc8-38f8-4e14-b692-254a4f83ced7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:43.078633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7adc8-38f8-4e14-b692-254a4f83ced7 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:43.079972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7adc8-38f8-4e14-b692-254a4f83ced7 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:43.081605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7adc8-38f8-4e14-b692-254a4f83ced7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:43.086881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 65/130] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:42 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:43.086881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7adc8-38f8-4e14-b692-254a4f83ced7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:43.106956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:43.133214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f83e7-05de-4468-9ec0-c2baa0b7a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:43.137157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f83e7-05de-4468-9ec0-c2baa0b7a08a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:43.137483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f83e7-05de-4468-9ec0-c2baa0b7a08a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:43.137798 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f83e7-05de-4468-9ec0-c2baa0b7a08a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:43.162438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f83e7-05de-4468-9ec0-c2baa0b7a08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-b89f83e7-05de-4468-9ec0-c2baa0b7a08a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:43.182420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:43.183382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:43.184224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:43.185476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 66/131] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:43.185476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f83e7-05de-4468-9ec0-c2baa0b7a08a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:43.220506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:43.280307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7adc8-38f8-4e14-b692-254a4f83ced7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:43.318952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8893b-5f99-4b16-b6ce-fa7dc777c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:43.319914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8893b-5f99-4b16-b6ce-fa7dc777c3a7 None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:43.320205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8893b-5f99-4b16-b6ce-fa7dc777c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:43.320490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8893b-5f99-4b16-b6ce-fa7dc777c3a7 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856/users/4cbdfb14b73a4a4d85d4cad1d9888bb0/roles/7252c7aaa32c4c28b47eedca12cee086` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:43.323494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8893b-5f99-4b16-b6ce-fa7dc777c3a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e3413dfe4e45d486e2cfee347f9856, user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0, role_id=7252c7aaa32c4c28b47eedca12cee086)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:43.325028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8893b-5f99-4b16-b6ce-fa7dc777c3a7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:43.341604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f83e7-05de-4468-9ec0-c2baa0b7a08a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:43.345671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 66/132] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:35:43 2022] PUT /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856/users/4cbdfb14b73a4a4d85d4cad1d9888bb0/roles/7252c7aaa32c4c28b47eedca12cee086 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:35:43.346745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8893b-5f99-4b16-b6ce-fa7dc777c3a7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:43.385986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baff45-d006-4773-a01d-093c8bac2a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:43.387469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baff45-d006-4773-a01d-093c8bac2a03 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:43.387933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baff45-d006-4773-a01d-093c8bac2a03 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:43.388388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baff45-d006-4773-a01d-093c8bac2a03 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856/users/082a7280c91e421382a44e080705c894/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:43.391150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baff45-d006-4773-a01d-093c8bac2a03 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e3413dfe4e45d486e2cfee347f9856, user_id=082a7280c91e421382a44e080705c894, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:43.393114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baff45-d006-4773-a01d-093c8bac2a03 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:43.409814 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 67/133] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:35:43 2022] PUT /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856/users/082a7280c91e421382a44e080705c894/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:35:43.411734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6eba-91c8-49eb-b7f7-30c2f8e11a6e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:43.412335 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6eba-91c8-49eb-b7f7-30c2f8e11a6e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:43.412828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6eba-91c8-49eb-b7f7-30c2f8e11a6e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:43.414583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 68/134] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:43.422682 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938251b9-f3e4-4b43-975a-8adc15e04ff9 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:43.423575 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938251b9-f3e4-4b43-975a-8adc15e04ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:43.424907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938251b9-f3e4-4b43-975a-8adc15e04ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:43.470328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-938251b9-f3e4-4b43-975a-8adc15e04ff9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:43.472380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-938251b9-f3e4-4b43-975a-8adc15e04ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:43.522591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:43.545837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8893b-5f99-4b16-b6ce-fa7dc777c3a7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:43.562566 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 69/135] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:43.573939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:43.604738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938251b9-f3e4-4b43-975a-8adc15e04ff9 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:43.646569 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:43.648500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:43.649128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:43.649128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:43.653766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:43.653766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:43.653766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:43.687978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 67/136] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:43.697761 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:43.772431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938251b9-f3e4-4b43-975a-8adc15e04ff9 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:43.817485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab8eb-b5af-421d-8658-3ed218591447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:43.819083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab8eb-b5af-421d-8658-3ed218591447 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:43.819597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab8eb-b5af-421d-8658-3ed218591447 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:43.820087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab8eb-b5af-421d-8658-3ed218591447 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:43.821989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab8eb-b5af-421d-8658-3ed218591447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:43.825078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab8eb-b5af-421d-8658-3ed218591447 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:43.829909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 70/137] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:43.834757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab8eb-b5af-421d-8658-3ed218591447 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:43.916716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:43.953647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2208459-8e1b-47b8-9a27-d493ab9af3a7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:43.985332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab8eb-b5af-421d-8658-3ed218591447 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:43.998906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437791e-288a-4517-9034-7754ba80fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:44.000118 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437791e-288a-4517-9034-7754ba80fef3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:44.000642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437791e-288a-4517-9034-7754ba80fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:44.001117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437791e-288a-4517-9034-7754ba80fef3 None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:44.002602 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437791e-288a-4517-9034-7754ba80fef3 None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:44.004485 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437791e-288a-4517-9034-7754ba80fef3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:44.006448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 68/138] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:43 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:44.013194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437791e-288a-4517-9034-7754ba80fef3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:44.027648 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23de67d-1316-4585-ba69-1f9ba9795867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:44.028523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de67d-1316-4585-ba69-1f9ba9795867 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:44.028751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de67d-1316-4585-ba69-1f9ba9795867 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:44.029042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23de67d-1316-4585-ba69-1f9ba9795867 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:44.029813 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23de67d-1316-4585-ba69-1f9ba9795867 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:44.031413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23de67d-1316-4585-ba69-1f9ba9795867 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:44.061249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 71/139] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:35:43 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:44.082359 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:44.149996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437791e-288a-4517-9034-7754ba80fef3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:44.188183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ac1d7-bb99-461c-a059-4d8b3daa3648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:44.189367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac1d7-bb99-461c-a059-4d8b3daa3648 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:44.189848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac1d7-bb99-461c-a059-4d8b3daa3648 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:44.190275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac1d7-bb99-461c-a059-4d8b3daa3648 None admin] PATH_INFO: `/v3/projects/f357607b080244fd94edad08e8349deb` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:44.191979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ac1d7-bb99-461c-a059-4d8b3daa3648 None admin] RBAC: Authorizing `identity:get_project(project_id=f357607b080244fd94edad08e8349deb)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:44.193828 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ac1d7-bb99-461c-a059-4d8b3daa3648 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:44.195888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 69/140] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:44 2022] GET /identity/v3/projects/f357607b080244fd94edad08e8349deb => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:44.202290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23de67d-1316-4585-ba69-1f9ba9795867 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:44.348526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:44.362646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23de67d-1316-4585-ba69-1f9ba9795867 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:44.414070 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87611d88-ecc6-4001-bbe5-a58ba5fb0d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:44.415151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87611d88-ecc6-4001-bbe5-a58ba5fb0d17 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:44.415442 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87611d88-ecc6-4001-bbe5-a58ba5fb0d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:44.415725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87611d88-ecc6-4001-bbe5-a58ba5fb0d17 None admin] PATH_INFO: `/v3/projects/f357607b080244fd94edad08e8349deb/users/4cbdfb14b73a4a4d85d4cad1d9888bb0/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:44.423861 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87611d88-ecc6-4001-bbe5-a58ba5fb0d17 None admin] RBAC: Authorizing `identity:create_grant(project_id=f357607b080244fd94edad08e8349deb, user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:44.425494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87611d88-ecc6-4001-bbe5-a58ba5fb0d17 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:44.444174 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 72/141] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:35:44 2022] PUT /identity/v3/projects/f357607b080244fd94edad08e8349deb/users/4cbdfb14b73a4a4d85d4cad1d9888bb0/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:35:45.033807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a36e-7db2-4958-a331-c50a0b0220b4 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:45.034319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a36e-7db2-4958-a331-c50a0b0220b4 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:45.034421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a36e-7db2-4958-a331-c50a0b0220b4 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:45.035805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 70/142] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:45.044120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b1392-2a0a-4b37-b745-89ab1e67320d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:45.044481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b1392-2a0a-4b37-b745-89ab1e67320d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:45.044690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b1392-2a0a-4b37-b745-89ab1e67320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:45.066300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-dc1b1392-2a0a-4b37-b745-89ab1e67320d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:45.067520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-dc1b1392-2a0a-4b37-b745-89ab1e67320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:45.155106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 73/143] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:45.190743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a36e-7db2-4958-a331-c50a0b0220b4 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:45.323806 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a36e-7db2-4958-a331-c50a0b0220b4 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:45.339731 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:45.376079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5b259-bf36-43f6-928d-799d304e19d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:45.376901 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5b259-bf36-43f6-928d-799d304e19d4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:45.377196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5b259-bf36-43f6-928d-799d304e19d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:45.377476 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5b259-bf36-43f6-928d-799d304e19d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:45.398375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5b259-bf36-43f6-928d-799d304e19d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4cf5b259-bf36-43f6-928d-799d304e19d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:45.406895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:45.408069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:45.409043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 71/144] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:45.415916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b1392-2a0a-4b37-b745-89ab1e67320d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:45.553579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:45.576592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b1392-2a0a-4b37-b745-89ab1e67320d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:45.618032 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:45.618722 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:45.619012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:45.619295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:45.620068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:45.620379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:45.622396 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:45.631811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 74/145] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:45.638392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5b259-bf36-43f6-928d-799d304e19d4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:45.823916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5b259-bf36-43f6-928d-799d304e19d4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:45.863577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a750d-2d0c-4b33-9e5c-dadadab65c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:45.864777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a750d-2d0c-4b33-9e5c-dadadab65c5e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:45.865260 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a750d-2d0c-4b33-9e5c-dadadab65c5e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:45.865750 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a750d-2d0c-4b33-9e5c-dadadab65c5e None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:45.867194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a750d-2d0c-4b33-9e5c-dadadab65c5e None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:45.868853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a750d-2d0c-4b33-9e5c-dadadab65c5e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:45.871617 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 72/146] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:45 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:45.876921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:46.035729 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e974f4f-74ff-4289-8545-06e097544d45 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:46.072059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f261-4ff8-4048-92cf-2914539b0790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:46.072808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f261-4ff8-4048-92cf-2914539b0790 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:46.073001 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f261-4ff8-4048-92cf-2914539b0790 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:46.073281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f261-4ff8-4048-92cf-2914539b0790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:46.092763 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:46.151621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f261-4ff8-4048-92cf-2914539b0790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:46.153611 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f261-4ff8-4048-92cf-2914539b0790 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:46.235375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde322e-20f4-44d1-9d5d-9441b504dfe0 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:46.236343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde322e-20f4-44d1-9d5d-9441b504dfe0 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:46.236891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde322e-20f4-44d1-9d5d-9441b504dfe0 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:46.238527 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 73/147] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:46.244919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5718a71-06bb-4884-9255-4b498906214a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:46.245208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5718a71-06bb-4884-9255-4b498906214a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:46.245488 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5718a71-06bb-4884-9255-4b498906214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:46.282448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-e5718a71-06bb-4884-9255-4b498906214a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:46.284031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-e5718a71-06bb-4884-9255-4b498906214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:46.298196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 75/148] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:46.304238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f261-4ff8-4048-92cf-2914539b0790 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:46.360051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:46.413389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:46.436081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 74/149] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:46.491483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5718a71-06bb-4884-9255-4b498906214a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:46.529187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f261-4ff8-4048-92cf-2914539b0790 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:46.619865 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe44d-90f9-4032-996c-c6881e89d8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:46.620749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe44d-90f9-4032-996c-c6881e89d8c4 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:46.621111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe44d-90f9-4032-996c-c6881e89d8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:46.621397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe44d-90f9-4032-996c-c6881e89d8c4 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:46.626511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbe44d-90f9-4032-996c-c6881e89d8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:46.628020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbe44d-90f9-4032-996c-c6881e89d8c4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:46.630137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 76/150] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:46 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:46.638254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe44d-90f9-4032-996c-c6881e89d8c4 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:46.767811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5718a71-06bb-4884-9255-4b498906214a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:46.855920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c9188-e18e-4dfc-b932-00b277d9d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:46.856984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c9188-e18e-4dfc-b932-00b277d9d824 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:46.857408 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c9188-e18e-4dfc-b932-00b277d9d824 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:46.857874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c9188-e18e-4dfc-b932-00b277d9d824 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:46.890637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c9188-e18e-4dfc-b932-00b277d9d824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-483c9188-e18e-4dfc-b932-00b277d9d824 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:46.898575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:46.899611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:35:46.900583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:46.906601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 75/151] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:35:46.912717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c9188-e18e-4dfc-b932-00b277d9d824 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:46.939948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe44d-90f9-4032-996c-c6881e89d8c4 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:46.985541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:46.987772 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:47.055129 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a71223-b51f-4621-ba46-6d8b6210c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:47.055737 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71223-b51f-4621-ba46-6d8b6210c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:47.056029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71223-b51f-4621-ba46-6d8b6210c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:47.056316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71223-b51f-4621-ba46-6d8b6210c3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:47.057169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a71223-b51f-4621-ba46-6d8b6210c3d7 None admin] RBAC: Adding query filter params (role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=37e3413dfe4e45d486e2cfee347f9856, user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:47.057487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a71223-b51f-4621-ba46-6d8b6210c3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:47.059040 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a71223-b51f-4621-ba46-6d8b6210c3d7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:47.073250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 77/152] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:46 2022] GET /identity/v3/role_assignments?user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 608 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:47.074696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01ffb8-33f8-4159-93da-12b368eb934b None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:47.074993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01ffb8-33f8-4159-93da-12b368eb934b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:47.075275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01ffb8-33f8-4159-93da-12b368eb934b None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:47.076604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 78/153] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:47.087352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab6f8-9aad-4c83-aeec-a5e300baab30 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:47.087678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab6f8-9aad-4c83-aeec-a5e300baab30 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:47.087928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab6f8-9aad-4c83-aeec-a5e300baab30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:47.126806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-288ab6f8-9aad-4c83-aeec-a5e300baab30 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:47.128037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-288ab6f8-9aad-4c83-aeec-a5e300baab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:47.180183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c9188-e18e-4dfc-b932-00b277d9d824 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:47.291556 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:47.292336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:47.292534 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:47.293354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:47.294165 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:47.294472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:47.295882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:47.313418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 76/154] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:47.319470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:47.331399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 79/155] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:47.371591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab6f8-9aad-4c83-aeec-a5e300baab30 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:47.524144 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:47.540433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914926-cb78-4be5-85e6-b2a9ffe902d8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:47.623365 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714de2d-3912-4914-ad1b-bf73a184a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:47.624284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714de2d-3912-4914-ad1b-bf73a184a7ff None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:47.624576 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714de2d-3912-4914-ad1b-bf73a184a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:47.624855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714de2d-3912-4914-ad1b-bf73a184a7ff None admin] PATH_INFO: `/v3/users/fb9d3c589eb04062be138959be0fc22c` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:47.626145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714de2d-3912-4914-ad1b-bf73a184a7ff None admin] RBAC: Authorizing `identity:get_user(user_id=fb9d3c589eb04062be138959be0fc22c)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:47.627621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714de2d-3912-4914-ad1b-bf73a184a7ff None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:47.629671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 77/156] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:47 2022] GET /identity/v3/users/fb9d3c589eb04062be138959be0fc22c => generated 289 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:47.634964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714de2d-3912-4914-ad1b-bf73a184a7ff None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:47.813966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab6f8-9aad-4c83-aeec-a5e300baab30 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:47.861225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:47.900980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b268-945b-4a84-869d-8a6ff6f489c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:47.901827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b268-945b-4a84-869d-8a6ff6f489c3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:47.902157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b268-945b-4a84-869d-8a6ff6f489c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:47.902484 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b268-945b-4a84-869d-8a6ff6f489c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:47.916720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714de2d-3912-4914-ad1b-bf73a184a7ff None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:47.928277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b268-945b-4a84-869d-8a6ff6f489c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-6055b268-945b-4a84-869d-8a6ff6f489c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:47.936971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:47.938023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:47.938804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 80/157] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 568 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:35:47.943977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b268-945b-4a84-869d-8a6ff6f489c3 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:48.056915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa03124-e790-4088-8e94-bdb4f243454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:48.057867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03124-e790-4088-8e94-bdb4f243454d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:48.058160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03124-e790-4088-8e94-bdb4f243454d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:48.060016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03124-e790-4088-8e94-bdb4f243454d None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:48.060340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa03124-e790-4088-8e94-bdb4f243454d None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:48.065982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa03124-e790-4088-8e94-bdb4f243454d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:48.068179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 78/158] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:47 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:48.069320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754d5f-bc99-47e3-8d74-75a72a646668 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:48.069613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754d5f-bc99-47e3-8d74-75a72a646668 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:48.069923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754d5f-bc99-47e3-8d74-75a72a646668 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:48.071193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 79/159] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:48.076972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c055-e381-4be4-8ed9-7b58c19bfacf None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:48.077256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c055-e381-4be4-8ed9-7b58c19bfacf None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:48.077547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c055-e381-4be4-8ed9-7b58c19bfacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:48.102893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-06f8c055-e381-4be4-8ed9-7b58c19bfacf None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:48.104113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-06f8c055-e381-4be4-8ed9-7b58c19bfacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:48.116080 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b268-945b-4a84-869d-8a6ff6f489c3 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:48.164937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:48.165552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:48.165872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:48.166161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:48.166937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:48.167250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:48.169222 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:48.185190 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 81/160] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:48.189133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:48.189938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:48.256268 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:48.304688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 80/161] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:48.306356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8c055-e381-4be4-8ed9-7b58c19bfacf None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:48.368688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc6f9-c708-4228-a35c-a722c7545083 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:48.431906 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06e1d-ce64-4b4f-ae35-b202cc407893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:48.433053 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06e1d-ce64-4b4f-ae35-b202cc407893 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:48.433521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06e1d-ce64-4b4f-ae35-b202cc407893 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:48.433970 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06e1d-ce64-4b4f-ae35-b202cc407893 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856/users/fb9d3c589eb04062be138959be0fc22c/roles/acb61715c6f849fca1c8d329abea7b1d` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:48.450578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef06e1d-ce64-4b4f-ae35-b202cc407893 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e3413dfe4e45d486e2cfee347f9856, user_id=fb9d3c589eb04062be138959be0fc22c, role_id=acb61715c6f849fca1c8d329abea7b1d)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:48.452276 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef06e1d-ce64-4b4f-ae35-b202cc407893 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:48.473792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8c055-e381-4be4-8ed9-7b58c19bfacf None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:48.499994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 82/162] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:35:48 2022] PUT /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856/users/fb9d3c589eb04062be138959be0fc22c/roles/acb61715c6f849fca1c8d329abea7b1d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:35:48.501067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06e1d-ce64-4b4f-ae35-b202cc407893 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:48.532102 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009382bc-2ba2-4064-884a-217d6eb58076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:48.533785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009382bc-2ba2-4064-884a-217d6eb58076 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:48.534392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009382bc-2ba2-4064-884a-217d6eb58076 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:48.535065 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009382bc-2ba2-4064-884a-217d6eb58076 None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:48.538907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009382bc-2ba2-4064-884a-217d6eb58076 None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:48.540705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009382bc-2ba2-4064-884a-217d6eb58076 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:48.543356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 81/163] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:48 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:48.549331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009382bc-2ba2-4064-884a-217d6eb58076 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:48.602054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:48.708810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009382bc-2ba2-4064-884a-217d6eb58076 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:48.709978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:48.728858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06e1d-ce64-4b4f-ae35-b202cc407893 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:48.772487 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9872405-112b-4fec-b265-6922ad90d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:48.773438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872405-112b-4fec-b265-6922ad90d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:48.773908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872405-112b-4fec-b265-6922ad90d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:48.774324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872405-112b-4fec-b265-6922ad90d1f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:48.822429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4004e-821a-4a95-86a6-574978fe95c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:48.823539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4004e-821a-4a95-86a6-574978fe95c1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:48.824497 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4004e-821a-4a95-86a6-574978fe95c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:48.824918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4004e-821a-4a95-86a6-574978fe95c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:48.852867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4004e-821a-4a95-86a6-574978fe95c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-a4a4004e-821a-4a95-86a6-574978fe95c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:48.860943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:48.862098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:48.863096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:48.873785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 83/164] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:48.875077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4004e-821a-4a95-86a6-574978fe95c1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:48.916707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9872405-112b-4fec-b265-6922ad90d1f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:48.918685 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9872405-112b-4fec-b265-6922ad90d1f7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:48.964480 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:49.030145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4004e-821a-4a95-86a6-574978fe95c1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:49.049953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 82/165] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:49.051775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc67c-731c-43d1-9073-00ee1127887b None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.052281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc67c-731c-43d1-9073-00ee1127887b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.053283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc67c-731c-43d1-9073-00ee1127887b None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.055150 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 83/166] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:49.056440 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdfd5e-1a91-400b-98c6-2e8a04ee5231 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.057004 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdfd5e-1a91-400b-98c6-2e8a04ee5231 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.057502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdfd5e-1a91-400b-98c6-2e8a04ee5231 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.059159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 84/167] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:49.060196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdfd5e-1a91-400b-98c6-2e8a04ee5231 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:49.084166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d406bc9-3a39-44fd-b57a-0b48323b36f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:49.085751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d406bc9-3a39-44fd-b57a-0b48323b36f7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.086544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d406bc9-3a39-44fd-b57a-0b48323b36f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.087030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d406bc9-3a39-44fd-b57a-0b48323b36f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.088364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d406bc9-3a39-44fd-b57a-0b48323b36f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:49.088855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d406bc9-3a39-44fd-b57a-0b48323b36f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:49.091568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d406bc9-3a39-44fd-b57a-0b48323b36f7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:49.103795 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 84/168] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:49.105866 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a6053-d8be-4acb-af68-55ad7300a0af None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.106341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a6053-d8be-4acb-af68-55ad7300a0af None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.107738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a6053-d8be-4acb-af68-55ad7300a0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.129175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-2c8a6053-d8be-4acb-af68-55ad7300a0af None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:49.131633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-2c8a6053-d8be-4acb-af68-55ad7300a0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:49.146756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:49.179669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdfd5e-1a91-400b-98c6-2e8a04ee5231 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:49.208100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:49.219172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf28fb-fdbe-4031-9ef7-a5289443bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:49.220099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf28fb-fdbe-4031-9ef7-a5289443bd6b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.220461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf28fb-fdbe-4031-9ef7-a5289443bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.220815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf28fb-fdbe-4031-9ef7-a5289443bd6b None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.222176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf28fb-fdbe-4031-9ef7-a5289443bd6b None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:49.223916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf28fb-fdbe-4031-9ef7-a5289443bd6b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:49.224705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 85/169] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:49.226287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d1c3-4bc7-4eb4-ac94-deb8fbccb9d0 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.226816 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d1c3-4bc7-4eb4-ac94-deb8fbccb9d0 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.227253 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d1c3-4bc7-4eb4-ac94-deb8fbccb9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.230106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 85/170] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:49 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:49.231869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf28fb-fdbe-4031-9ef7-a5289443bd6b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:49.265550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b2e6d1c3-4bc7-4eb4-ac94-deb8fbccb9d0 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:49.267429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b2e6d1c3-4bc7-4eb4-ac94-deb8fbccb9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:49.343181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 86/171] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:49.344267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6d1c3-4bc7-4eb4-ac94-deb8fbccb9d0 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:49.380929 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf28fb-fdbe-4031-9ef7-a5289443bd6b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:49.424407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5ecea-9e71-4234-8767-ffd3d1c7f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:49.425877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5ecea-9e71-4234-8767-ffd3d1c7f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.426360 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5ecea-9e71-4234-8767-ffd3d1c7f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.427066 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5ecea-9e71-4234-8767-ffd3d1c7f5a6 None admin] PATH_INFO: `/v3/users/082a7280c91e421382a44e080705c894` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.429250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5ecea-9e71-4234-8767-ffd3d1c7f5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=082a7280c91e421382a44e080705c894)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:49.431659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5ecea-9e71-4234-8767-ffd3d1c7f5a6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:49.435386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 86/172] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:49 2022] GET /identity/v3/users/082a7280c91e421382a44e080705c894 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:49.436717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5ecea-9e71-4234-8767-ffd3d1c7f5a6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:49.451031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:49.484649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6d1c3-4bc7-4eb4-ac94-deb8fbccb9d0 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:49.516039 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:49.535010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:49.536355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.537075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.537527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.538841 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] RBAC: Adding query filter params (role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=37e3413dfe4e45d486e2cfee347f9856, user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:49.539777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:49.541665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:49.552738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 87/173] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:49 2022] GET /identity/v3/role_assignments?user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:49.553971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:49.571115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5ecea-9e71-4234-8767-ffd3d1c7f5a6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:49.633161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7836f8-621d-444a-9587-212586f56708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:49.634093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7836f8-621d-444a-9587-212586f56708 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.634439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7836f8-621d-444a-9587-212586f56708 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.634728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7836f8-621d-444a-9587-212586f56708 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.656214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7836f8-621d-444a-9587-212586f56708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-7a7836f8-621d-444a-9587-212586f56708 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:49.670249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:49.671208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:49.672426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 87/174] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:49.673168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7836f8-621d-444a-9587-212586f56708 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:49.682649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a61fe-ee3a-4418-a255-0f389f548a3c None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:49.722092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c6e86-4f30-4713-af71-b819d27235e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:49.723299 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6e86-4f30-4713-af71-b819d27235e8 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.723781 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6e86-4f30-4713-af71-b819d27235e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.724274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6e86-4f30-4713-af71-b819d27235e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.732686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:49.739036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c6e86-4f30-4713-af71-b819d27235e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-dd7c6e86-4f30-4713-af71-b819d27235e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:49.748940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:49.750217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:49.751014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:49.753567 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 88/175] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:49.754585 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c6e86-4f30-4713-af71-b819d27235e8 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:49.802798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7836f8-621d-444a-9587-212586f56708 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:49.828990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:49.843916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c64d-a590-4274-bcf2-03decdcbad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:49.844645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c64d-a590-4274-bcf2-03decdcbad8e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.844936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c64d-a590-4274-bcf2-03decdcbad8e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.845217 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c64d-a590-4274-bcf2-03decdcbad8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.867779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c6e86-4f30-4713-af71-b819d27235e8 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:49.904631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:49.905686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:49.906293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:49.906877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:49.907836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:49.908343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:49.910193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:49.919955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 89/176] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:49.920133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c64d-a590-4274-bcf2-03decdcbad8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:49.921387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:49.921581 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c64d-a590-4274-bcf2-03decdcbad8e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:49.990305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:50.037316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef955-1ee5-445e-a7fc-ab1539b1eb76 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:50.076019 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0b576-9d5d-4861-93b3-5887192ab6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:50.077058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b576-9d5d-4861-93b3-5887192ab6fd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.077543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b576-9d5d-4861-93b3-5887192ab6fd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.078119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b576-9d5d-4861-93b3-5887192ab6fd None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.078235 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 88/177] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:50.079075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c64d-a590-4274-bcf2-03decdcbad8e None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:50.079474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0b576-9d5d-4861-93b3-5887192ab6fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:50.079790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0b576-9d5d-4861-93b3-5887192ab6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:50.081200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0b576-9d5d-4861-93b3-5887192ab6fd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:50.094733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 90/178] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:50.096392 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad659e-fde6-4dd4-9252-9f697d97668f None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.096890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad659e-fde6-4dd4-9252-9f697d97668f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.097375 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad659e-fde6-4dd4-9252-9f697d97668f None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.098961 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 91/179] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:50.100311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9079-6fce-4fcf-848d-acea18352701 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.100802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9079-6fce-4fcf-848d-acea18352701 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.101276 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9079-6fce-4fcf-848d-acea18352701 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.102759 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 92/180] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:50.103683 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d9079-6fce-4fcf-848d-acea18352701 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:50.107209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:50.202172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c64d-a590-4274-bcf2-03decdcbad8e None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:50.248154 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749861c6-d3cf-474c-92f0-b0e1582544fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:50.249434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749861c6-d3cf-474c-92f0-b0e1582544fe None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.250134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749861c6-d3cf-474c-92f0-b0e1582544fe None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.250424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749861c6-d3cf-474c-92f0-b0e1582544fe None admin] PATH_INFO: `/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.251714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749861c6-d3cf-474c-92f0-b0e1582544fe None admin] RBAC: Authorizing `identity:get_user(user_id=4cbdfb14b73a4a4d85d4cad1d9888bb0)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:50.253412 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749861c6-d3cf-474c-92f0-b0e1582544fe None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:50.255316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 89/181] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:50 2022] GET /identity/v3/users/4cbdfb14b73a4a4d85d4cad1d9888bb0 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:50.256601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bb01e-f42d-41b9-86dd-f979c1acfd9c None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.256891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bb01e-f42d-41b9-86dd-f979c1acfd9c None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.257169 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bb01e-f42d-41b9-86dd-f979c1acfd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.264568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d9079-6fce-4fcf-848d-acea18352701 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:50.273841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-ed9bb01e-f42d-41b9-86dd-f979c1acfd9c None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:50.275027 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-ed9bb01e-f42d-41b9-86dd-f979c1acfd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:50.290162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:50.304211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270d91-be7c-4741-9606-cc185c9dfc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:50.305078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270d91-be7c-4741-9606-cc185c9dfc5f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.305365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270d91-be7c-4741-9606-cc185c9dfc5f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.305646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28270d91-be7c-4741-9606-cc185c9dfc5f None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.306845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28270d91-be7c-4741-9606-cc185c9dfc5f None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:50.308936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28270d91-be7c-4741-9606-cc185c9dfc5f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:50.310771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 93/182] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:50 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:50.311543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270d91-be7c-4741-9606-cc185c9dfc5f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:50.345170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 90/183] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:50.355802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e21f-acf0-4bb7-bc31-9df2f22b7dcc None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.356206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e21f-acf0-4bb7-bc31-9df2f22b7dcc None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.356740 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e21f-acf0-4bb7-bc31-9df2f22b7dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.376323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-cd84e21f-acf0-4bb7-bc31-9df2f22b7dcc None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:50.377520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-cd84e21f-acf0-4bb7-bc31-9df2f22b7dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:50.392915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:50.424973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28270d91-be7c-4741-9606-cc185c9dfc5f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:50.452776 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 91/184] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:50.453945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e21f-acf0-4bb7-bc31-9df2f22b7dcc None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:50.465748 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e587c1d-1ead-4a0e-ae07-1f1f3bfa83b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:50.467146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587c1d-1ead-4a0e-ae07-1f1f3bfa83b1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.467500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587c1d-1ead-4a0e-ae07-1f1f3bfa83b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.468009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587c1d-1ead-4a0e-ae07-1f1f3bfa83b1 None admin] PATH_INFO: `/v3/users/33317a2774e5455fa52a8ff2ac2bcbed` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.485412 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e587c1d-1ead-4a0e-ae07-1f1f3bfa83b1 None admin] RBAC: Authorizing `identity:get_user(user_id=33317a2774e5455fa52a8ff2ac2bcbed)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:50.486946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e587c1d-1ead-4a0e-ae07-1f1f3bfa83b1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:50.488876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 94/185] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:50 2022] GET /identity/v3/users/33317a2774e5455fa52a8ff2ac2bcbed => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:50.489568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e587c1d-1ead-4a0e-ae07-1f1f3bfa83b1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:50.544605 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:50.566757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e21f-acf0-4bb7-bc31-9df2f22b7dcc None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:50.599472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e587c1d-1ead-4a0e-ae07-1f1f3bfa83b1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:50.601788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd095d-46fe-4f1c-9ad4-f6ac97aebffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:50.602450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd095d-46fe-4f1c-9ad4-f6ac97aebffe None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.602730 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd095d-46fe-4f1c-9ad4-f6ac97aebffe None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.603007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd095d-46fe-4f1c-9ad4-f6ac97aebffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.622763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:50.640071 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:50.640735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.641026 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.641308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.642172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=37e3413dfe4e45d486e2cfee347f9856, user.id=082a7280c91e421382a44e080705c894) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:50.642486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:50.643945 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:50.649890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 95/186] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:50 2022] GET /identity/v3/role_assignments?user.id=082a7280c91e421382a44e080705c894&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:50.650685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:50.702489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd095d-46fe-4f1c-9ad4-f6ac97aebffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:50.704958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd095d-46fe-4f1c-9ad4-f6ac97aebffe None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:50.775635 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec1585-dd61-41dd-9248-3051fd9195e9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:50.790957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:50.817812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244f02-6f17-43eb-8c5a-b73cd079f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:50.818986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244f02-6f17-43eb-8c5a-b73cd079f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:50.819459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244f02-6f17-43eb-8c5a-b73cd079f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:50.819931 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244f02-6f17-43eb-8c5a-b73cd079f1e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:50.832437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244f02-6f17-43eb-8c5a-b73cd079f1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:50.837218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 92/187] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:50.839174 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd095d-46fe-4f1c-9ad4-f6ac97aebffe None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-0b244f02-6f17-43eb-8c5a-b73cd079f1e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:50.842439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:50.843370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:50.844229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:50.846777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 96/188] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:35:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:50.848058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244f02-6f17-43eb-8c5a-b73cd079f1e1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:50.902656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:50.974215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd095d-46fe-4f1c-9ad4-f6ac97aebffe None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:50.976050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244f02-6f17-43eb-8c5a-b73cd079f1e1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.011848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fad7-8387-44ed-b69b-b93ca85f64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.012655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fad7-8387-44ed-b69b-b93ca85f64ba None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.012938 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fad7-8387-44ed-b69b-b93ca85f64ba None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.013213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fad7-8387-44ed-b69b-b93ca85f64ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.014496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0fad7-8387-44ed-b69b-b93ca85f64ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.015984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0fad7-8387-44ed-b69b-b93ca85f64ba None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.016592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b4713-310c-4555-8f58-c6945d2c54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.017440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4713-310c-4555-8f58-c6945d2c54c2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.017675 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 93/189] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:51.018142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4713-310c-4555-8f58-c6945d2c54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.018666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4713-310c-4555-8f58-c6945d2c54c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.022624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fad7-8387-44ed-b69b-b93ca85f64ba None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:51.062067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:51.092702 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b4713-310c-4555-8f58-c6945d2c54c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.094172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b4713-310c-4555-8f58-c6945d2c54c2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.131343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fad7-8387-44ed-b69b-b93ca85f64ba None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.149702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:51.169103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e876f-db68-4aeb-be05-d0b13dc6d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.170093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e876f-db68-4aeb-be05-d0b13dc6d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.170381 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e876f-db68-4aeb-be05-d0b13dc6d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.170656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e876f-db68-4aeb-be05-d0b13dc6d0d8 None admin] PATH_INFO: `/v3/projects/f357607b080244fd94edad08e8349deb` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.171874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e876f-db68-4aeb-be05-d0b13dc6d0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=f357607b080244fd94edad08e8349deb)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.173330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e876f-db68-4aeb-be05-d0b13dc6d0d8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.175113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 94/190] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:51 2022] GET /identity/v3/projects/f357607b080244fd94edad08e8349deb => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:51.175887 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e876f-db68-4aeb-be05-d0b13dc6d0d8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:51.207529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 97/191] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:51.208405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b4713-310c-4555-8f58-c6945d2c54c2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:51.286720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e876f-db68-4aeb-be05-d0b13dc6d0d8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.302130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:51.323775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.325075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.325670 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.325800 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.326494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:51.326801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.328172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.328276 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b4713-310c-4555-8f58-c6945d2c54c2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.338062 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 95/192] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:35:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:51.338802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:51.367561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d6bb-c1d5-4ea5-b393-576bad86419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.368161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d6bb-c1d5-4ea5-b393-576bad86419b None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.368446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d6bb-c1d5-4ea5-b393-576bad86419b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.368726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d6bb-c1d5-4ea5-b393-576bad86419b None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.369430 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63d6bb-c1d5-4ea5-b393-576bad86419b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.370949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63d6bb-c1d5-4ea5-b393-576bad86419b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.392259 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:51.393262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 98/193] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:35:51 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:51.394289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d6bb-c1d5-4ea5-b393-576bad86419b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:51.479623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0f30-c365-4b77-85cb-762033831f0d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.532713 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.534431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.534952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.535416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.536379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d6bb-c1d5-4ea5-b393-576bad86419b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.536662 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] RBAC: Adding query filter params (role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=f357607b080244fd94edad08e8349deb, user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:51.537166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.540239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.548737 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 96/194] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:51 2022] GET /identity/v3/role_assignments?user.id=4cbdfb14b73a4a4d85d4cad1d9888bb0&scope.project.id=f357607b080244fd94edad08e8349deb&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:51.550352 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:51.598573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:51.616534 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e605fc-ded1-44d5-a22d-fc1033c632e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.617349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e605fc-ded1-44d5-a22d-fc1033c632e2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.617696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e605fc-ded1-44d5-a22d-fc1033c632e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.618023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e605fc-ded1-44d5-a22d-fc1033c632e2 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.623992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e605fc-ded1-44d5-a22d-fc1033c632e2 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.625758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e605fc-ded1-44d5-a22d-fc1033c632e2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.628043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 99/195] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:51 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:51.634445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e605fc-ded1-44d5-a22d-fc1033c632e2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:51.720077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06cf7c-c85c-4b27-8ecf-93768b54c131 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.734866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:51.763925 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e605fc-ded1-44d5-a22d-fc1033c632e2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.774489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4f12a-ea29-496d-b312-baa3078335f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.775338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f12a-ea29-496d-b312-baa3078335f2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.775689 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f12a-ea29-496d-b312-baa3078335f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.775903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f12a-ea29-496d-b312-baa3078335f2 None admin] PATH_INFO: `/v3/users/33317a2774e5455fa52a8ff2ac2bcbed` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.778540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4f12a-ea29-496d-b312-baa3078335f2 None admin] RBAC: Authorizing `identity:get_user(user_id=33317a2774e5455fa52a8ff2ac2bcbed)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.780276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4f12a-ea29-496d-b312-baa3078335f2 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.782295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 97/196] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:51 2022] GET /identity/v3/users/33317a2774e5455fa52a8ff2ac2bcbed => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:51.783942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfab9-3f4d-4483-837e-f5d6dbe19674 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.784437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfab9-3f4d-4483-837e-f5d6dbe19674 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.784916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfab9-3f4d-4483-837e-f5d6dbe19674 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.786585 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 98/197] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:51.791003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cfab9-3f4d-4483-837e-f5d6dbe19674 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:51.829024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7285b-efe6-465d-a849-599cf0c2e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.829699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7285b-efe6-465d-a849-599cf0c2e551 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.830097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7285b-efe6-465d-a849-599cf0c2e551 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.830381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7285b-efe6-465d-a849-599cf0c2e551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.831261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7285b-efe6-465d-a849-599cf0c2e551 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=0388b88e9f734e8a8e7feadddec96738, user.id=33317a2774e5455fa52a8ff2ac2bcbed) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:51.831549 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7285b-efe6-465d-a849-599cf0c2e551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:51.833104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7285b-efe6-465d-a849-599cf0c2e551 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:51.841891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 100/198] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:51 2022] GET /identity/v3/role_assignments?user.id=33317a2774e5455fa52a8ff2ac2bcbed&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:51.843212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb0c2-8beb-4965-a1d5-18324059039e None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.843507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb0c2-8beb-4965-a1d5-18324059039e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.843791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb0c2-8beb-4965-a1d5-18324059039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.867502 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-f92cb0c2-8beb-4965-a1d5-18324059039e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:51.869149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-f92cb0c2-8beb-4965-a1d5-18324059039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:51.924383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cfab9-3f4d-4483-837e-f5d6dbe19674 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:51.943220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:51.958574 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 101/199] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:51.975777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21819-bec6-4722-94bb-cbb1c876fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:51.976447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21819-bec6-4722-94bb-cbb1c876fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:51.976729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21819-bec6-4722-94bb-cbb1c876fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:51.977057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21819-bec6-4722-94bb-cbb1c876fbf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:51.982421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cb0c2-8beb-4965-a1d5-18324059039e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:52.073781 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:52.103583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a21819-bec6-4722-94bb-cbb1c876fbf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:52.105984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a21819-bec6-4722-94bb-cbb1c876fbf1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:52.147149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cb0c2-8beb-4965-a1d5-18324059039e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:52.210726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57b9ee-a1bd-4a52-a9e1-7575cf9007ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:52.211558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b9ee-a1bd-4a52-a9e1-7575cf9007ca None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:52.211842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b9ee-a1bd-4a52-a9e1-7575cf9007ca None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:52.212158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57b9ee-a1bd-4a52-a9e1-7575cf9007ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:52.219140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 99/200] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:35:52.224971 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21819-bec6-4722-94bb-cbb1c876fbf1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:52.229293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57b9ee-a1bd-4a52-a9e1-7575cf9007ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-bc57b9ee-a1bd-4a52-a9e1-7575cf9007ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:52.245999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:52.246973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:52.247805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 102/201] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:35:52.266694 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57b9ee-a1bd-4a52-a9e1-7575cf9007ca None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:52.322603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:52.345177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21819-bec6-4722-94bb-cbb1c876fbf1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:52.383128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7cb42-0eb5-4ca1-8968-e86406d510ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:52.384365 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7cb42-0eb5-4ca1-8968-e86406d510ec None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:52.384879 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7cb42-0eb5-4ca1-8968-e86406d510ec None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:52.385411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7cb42-0eb5-4ca1-8968-e86406d510ec None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:52.387001 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7cb42-0eb5-4ca1-8968-e86406d510ec None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:52.388672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7cb42-0eb5-4ca1-8968-e86406d510ec None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:52.390946 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 100/202] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:52 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:52.396775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7cb42-0eb5-4ca1-8968-e86406d510ec None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:52.410169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:52.504785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7cb42-0eb5-4ca1-8968-e86406d510ec None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:52.517039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57b9ee-a1bd-4a52-a9e1-7575cf9007ca None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:52.545173 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:52.546245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:52.546733 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:52.547206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:52.548254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] RBAC: Adding query filter params (role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=0388b88e9f734e8a8e7feadddec96738, user.id=33317a2774e5455fa52a8ff2ac2bcbed) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:52.548902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:52.550626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:52.556941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 101/203] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:52 2022] GET /identity/v3/role_assignments?user.id=33317a2774e5455fa52a8ff2ac2bcbed&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:52.587674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:52.588763 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:52.589253 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:52.590304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:52.591274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] RBAC: Adding query filter params (name=reader) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:52.591785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:52.593468 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:52.609483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 103/204] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:52.615677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:52.640512 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:52.767944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aebb4-7e2a-4764-ab5a-9a5007c2670f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:52.832234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d39b1-f923-47b7-80a8-45ce10938938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:52.833124 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d39b1-f923-47b7-80a8-45ce10938938 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:52.833410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d39b1-f923-47b7-80a8-45ce10938938 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:52.833690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d39b1-f923-47b7-80a8-45ce10938938 None admin] PATH_INFO: `/v3/users/fb9d3c589eb04062be138959be0fc22c` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:52.834928 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d39b1-f923-47b7-80a8-45ce10938938 None admin] RBAC: Authorizing `identity:get_user(user_id=fb9d3c589eb04062be138959be0fc22c)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:52.836632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d39b1-f923-47b7-80a8-45ce10938938 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:52.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 102/205] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:52 2022] GET /identity/v3/users/fb9d3c589eb04062be138959be0fc22c => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:52.844747 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:52.964006 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928765d9-8862-48d3-a04a-2a03b164b3de None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:52.982153 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:53.018848 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9cda6-0c7c-47a7-9ef4-0ff33c770432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:53.019446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9cda6-0c7c-47a7-9ef4-0ff33c770432 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:53.019735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9cda6-0c7c-47a7-9ef4-0ff33c770432 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:53.020015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9cda6-0c7c-47a7-9ef4-0ff33c770432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:53.105967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9cda6-0c7c-47a7-9ef4-0ff33c770432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:53.107464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9cda6-0c7c-47a7-9ef4-0ff33c770432 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:53.238493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 104/206] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:53.244145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d39b1-f923-47b7-80a8-45ce10938938 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:53.432318 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:53.465490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d39b1-f923-47b7-80a8-45ce10938938 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:53.518494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc28f2-53bb-4fca-8652-26a2eaf2be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:53.520182 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc28f2-53bb-4fca-8652-26a2eaf2be07 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:53.520665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc28f2-53bb-4fca-8652-26a2eaf2be07 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:53.521137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc28f2-53bb-4fca-8652-26a2eaf2be07 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:53.522634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc28f2-53bb-4fca-8652-26a2eaf2be07 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:53.524294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc28f2-53bb-4fca-8652-26a2eaf2be07 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:53.526254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 103/207] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:53 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:53.531994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9cda6-0c7c-47a7-9ef4-0ff33c770432 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:53.549890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:53.676798 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9cda6-0c7c-47a7-9ef4-0ff33c770432 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:53.726044 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23b995-2149-4317-995d-b54e9e69052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:53.726628 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23b995-2149-4317-995d-b54e9e69052d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:53.726915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23b995-2149-4317-995d-b54e9e69052d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:53.727196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23b995-2149-4317-995d-b54e9e69052d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:53.728027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23b995-2149-4317-995d-b54e9e69052d None admin] RBAC: Adding query filter params (role.id=acb61715c6f849fca1c8d329abea7b1d, scope.project.id=37e3413dfe4e45d486e2cfee347f9856, user.id=fb9d3c589eb04062be138959be0fc22c) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:53.728405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23b995-2149-4317-995d-b54e9e69052d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:53.729937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23b995-2149-4317-995d-b54e9e69052d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:53.746900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 105/208] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:53 2022] GET /identity/v3/role_assignments?user.id=fb9d3c589eb04062be138959be0fc22c&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=acb61715c6f849fca1c8d329abea7b1d => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:54.327571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c85de-63d2-4cec-bdab-fbdd9b619f85 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.328265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c85de-63d2-4cec-bdab-fbdd9b619f85 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.328776 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c85de-63d2-4cec-bdab-fbdd9b619f85 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.330421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 104/209] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:54.337029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba1d4-2a61-403e-872b-8740fee72314 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.337029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba1d4-2a61-403e-872b-8740fee72314 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.337029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ba1d4-2a61-403e-872b-8740fee72314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.357171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-ea0ba1d4-2a61-403e-872b-8740fee72314 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:54.358811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ea0ba1d4-2a61-403e-872b-8740fee72314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:54.412686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635099a6-69bd-436c-98bc-08a6f6adcbd9 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.412997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635099a6-69bd-436c-98bc-08a6f6adcbd9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.413244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635099a6-69bd-436c-98bc-08a6f6adcbd9 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.415505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 105/210] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:54.422100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a678b-d53e-4a50-abf0-8080ffcac601 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.422938 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a678b-d53e-4a50-abf0-8080ffcac601 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.423452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a678b-d53e-4a50-abf0-8080ffcac601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.446870 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-a76a678b-d53e-4a50-abf0-8080ffcac601 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:54.448395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-a76a678b-d53e-4a50-abf0-8080ffcac601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:54.451970 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 106/211] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:54.481182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ba1d4-2a61-403e-872b-8740fee72314 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:54.493136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:54.540377 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 106/212] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:54.564523 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a678b-d53e-4a50-abf0-8080ffcac601 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:54.612564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ba1d4-2a61-403e-872b-8740fee72314 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:54.656290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5066-8667-4476-a464-3e3b5764f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:54.657535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5066-8667-4476-a464-3e3b5764f51e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.658564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5066-8667-4476-a464-3e3b5764f51e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.659171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5066-8667-4476-a464-3e3b5764f51e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.662142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde5066-8667-4476-a464-3e3b5764f51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:54.663991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde5066-8667-4476-a464-3e3b5764f51e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:54.666922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 107/213] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:54.674497 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5066-8667-4476-a464-3e3b5764f51e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:54.682335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:54.707129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a678b-d53e-4a50-abf0-8080ffcac601 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:54.741770 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e51d-7d6f-49a2-a741-ffb4d8e57014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:54.742850 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e51d-7d6f-49a2-a741-ffb4d8e57014 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.743137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e51d-7d6f-49a2-a741-ffb4d8e57014 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.743417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e51d-7d6f-49a2-a741-ffb4d8e57014 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.754498 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02e51d-7d6f-49a2-a741-ffb4d8e57014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:54.759262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-bd02e51d-7d6f-49a2-a741-ffb4d8e57014 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:54.762972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:54.764067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:54.764911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 107/214] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:35:54.765629 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da109c-047c-4d7c-b6d4-04480abf3070 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.765950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da109c-047c-4d7c-b6d4-04480abf3070 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.766239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da109c-047c-4d7c-b6d4-04480abf3070 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.771502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 108/215] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:54.772885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7535-6e44-4c9d-aa32-7995ae4de0f1 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.773252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7535-6e44-4c9d-aa32-7995ae4de0f1 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.773559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7535-6e44-4c9d-aa32-7995ae4de0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.793954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-fa8a7535-6e44-4c9d-aa32-7995ae4de0f1 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:54.795146 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-fa8a7535-6e44-4c9d-aa32-7995ae4de0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:54.800084 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5066-8667-4476-a464-3e3b5764f51e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:54.836526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ef7e7-f6d4-4d98-b571-32f455fe8060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:54.837332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ef7e7-f6d4-4d98-b571-32f455fe8060 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:54.837677 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ef7e7-f6d4-4d98-b571-32f455fe8060 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:54.837997 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ef7e7-f6d4-4d98-b571-32f455fe8060 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:54.838776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ef7e7-f6d4-4d98-b571-32f455fe8060 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:54.840662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ef7e7-f6d4-4d98-b571-32f455fe8060 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:54.869877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 108/216] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:35:54 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:35:54.869877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ef7e7-f6d4-4d98-b571-32f455fe8060 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:54.882371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 109/217] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:54.902484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7535-6e44-4c9d-aa32-7995ae4de0f1 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:54.982642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:54.988300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ef7e7-f6d4-4d98-b571-32f455fe8060 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.022823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:55.024785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7535-6e44-4c9d-aa32-7995ae4de0f1 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.031082 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.031806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.032130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.032401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.034992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:55.035601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:55.037247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:55.050149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 109/218] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:55.057688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.076267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302a03a-79e0-4670-8881-f2e248fb340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.077089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302a03a-79e0-4670-8881-f2e248fb340e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.077383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302a03a-79e0-4670-8881-f2e248fb340e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.077668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302a03a-79e0-4670-8881-f2e248fb340e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.090989 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302a03a-79e0-4670-8881-f2e248fb340e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-8302a03a-79e0-4670-8881-f2e248fb340e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:55.098877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:55.099874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:55.100681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 110/219] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:35:55.101453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69604-f027-4afb-9baf-f60a6dd2c67a None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.101767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69604-f027-4afb-9baf-f60a6dd2c67a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.102160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69604-f027-4afb-9baf-f60a6dd2c67a None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.103399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 111/220] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:55.108014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69604-f027-4afb-9baf-f60a6dd2c67a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.189065 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a43d3-a7b9-4727-93a0-b0b1af5a3a86 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.229875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a6e35-470d-4582-8a50-e212d774c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.231369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a6e35-470d-4582-8a50-e212d774c70b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.231656 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a6e35-470d-4582-8a50-e212d774c70b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.231939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a6e35-470d-4582-8a50-e212d774c70b None admin] PATH_INFO: `/v3/users/4b3e9284832e456c8ca536c5583a9773` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.237427 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69604-f027-4afb-9baf-f60a6dd2c67a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.247976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a6e35-470d-4582-8a50-e212d774c70b None admin] RBAC: Authorizing `identity:get_user(user_id=4b3e9284832e456c8ca536c5583a9773)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:55.249538 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a6e35-470d-4582-8a50-e212d774c70b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:55.251491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 110/221] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:55 2022] GET /identity/v3/users/4b3e9284832e456c8ca536c5583a9773 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:55.257108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb73b6-f3ae-4d7a-b876-376f9967edbd None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.257409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb73b6-f3ae-4d7a-b876-376f9967edbd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.257696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb73b6-f3ae-4d7a-b876-376f9967edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.267773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:55.276840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-8ffb73b6-f3ae-4d7a-b876-376f9967edbd None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:55.278863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.278863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.279080 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-8ffb73b6-f3ae-4d7a-b876-376f9967edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:55.279153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.279153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.279893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:55.280188 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:55.282740 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:55.295017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 112/222] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:55.296142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.351135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:55.377343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 111/223] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:55.378373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb73b6-f3ae-4d7a-b876-376f9967edbd None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.418373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ab4e0-7cef-4850-900a-6932828eb660 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.460129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8532-9582-4b52-80d7-4d299d98a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.460954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8532-9582-4b52-80d7-4d299d98a470 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.461336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8532-9582-4b52-80d7-4d299d98a470 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.461621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8532-9582-4b52-80d7-4d299d98a470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.507749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb73b6-f3ae-4d7a-b876-376f9967edbd None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.526123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:55.538487 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8532-9582-4b52-80d7-4d299d98a470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:55.539911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8532-9582-4b52-80d7-4d299d98a470 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:55.546815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a562b7a-40d2-4208-8095-766e5215dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.547715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562b7a-40d2-4208-8095-766e5215dd9a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.548004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562b7a-40d2-4208-8095-766e5215dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.548283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562b7a-40d2-4208-8095-766e5215dd9a None admin] PATH_INFO: `/v3/users/33317a2774e5455fa52a8ff2ac2bcbed` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.549525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a562b7a-40d2-4208-8095-766e5215dd9a None admin] RBAC: Authorizing `identity:get_user(user_id=33317a2774e5455fa52a8ff2ac2bcbed)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:55.551243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a562b7a-40d2-4208-8095-766e5215dd9a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:55.553037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 112/224] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:55 2022] GET /identity/v3/users/33317a2774e5455fa52a8ff2ac2bcbed => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:55.553710 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a562b7a-40d2-4208-8095-766e5215dd9a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.606635 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:55.654156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 113/225] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:35:55.655142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8532-9582-4b52-80d7-4d299d98a470 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.660751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a562b7a-40d2-4208-8095-766e5215dd9a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.697047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133940a-1c8d-40fc-b780-c0b0469a38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.697907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133940a-1c8d-40fc-b780-c0b0469a38c3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.698203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133940a-1c8d-40fc-b780-c0b0469a38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.698486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133940a-1c8d-40fc-b780-c0b0469a38c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.709774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133940a-1c8d-40fc-b780-c0b0469a38c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-6133940a-1c8d-40fc-b780-c0b0469a38c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:55.718993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:55.720100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 113/226] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:55.721012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133940a-1c8d-40fc-b780-c0b0469a38c3 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.757803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:55.775919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8532-9582-4b52-80d7-4d299d98a470 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.827258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4914-f07d-4abf-8d9e-5a44060e47e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.828273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4914-f07d-4abf-8d9e-5a44060e47e4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.828657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4914-f07d-4abf-8d9e-5a44060e47e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.829033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4914-f07d-4abf-8d9e-5a44060e47e4 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.830400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f4914-f07d-4abf-8d9e-5a44060e47e4 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:55.832657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f4914-f07d-4abf-8d9e-5a44060e47e4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:55.835065 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 114/227] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:55 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:55.838642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4914-f07d-4abf-8d9e-5a44060e47e4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.875042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133940a-1c8d-40fc-b780-c0b0469a38c3 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.886999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:55.923604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710e99e-7c98-44cb-bd6b-09abceba705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.925162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e99e-7c98-44cb-bd6b-09abceba705d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.925550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e99e-7c98-44cb-bd6b-09abceba705d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.925973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e99e-7c98-44cb-bd6b-09abceba705d None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.927716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710e99e-7c98-44cb-bd6b-09abceba705d None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:55.929873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710e99e-7c98-44cb-bd6b-09abceba705d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:55.937317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 114/228] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:55 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:55.937317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710e99e-7c98-44cb-bd6b-09abceba705d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:55.956841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4914-f07d-4abf-8d9e-5a44060e47e4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:55.993235 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:55.994159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:55.994646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:55.995132 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:55.996633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:55.997125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:55.998759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:56.007856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 115/229] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:35:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:56.009046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:56.033827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:56.073833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710e99e-7c98-44cb-bd6b-09abceba705d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:56.110105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215bd5-0450-4f44-8467-7e5a34585f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:56.111319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215bd5-0450-4f44-8467-7e5a34585f1e None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:56.111787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215bd5-0450-4f44-8467-7e5a34585f1e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:56.112278 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215bd5-0450-4f44-8467-7e5a34585f1e None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738/users/33317a2774e5455fa52a8ff2ac2bcbed/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:56.114729 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea215bd5-0450-4f44-8467-7e5a34585f1e None admin] RBAC: Authorizing `identity:create_grant(project_id=0388b88e9f734e8a8e7feadddec96738, user_id=33317a2774e5455fa52a8ff2ac2bcbed, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:56.116441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea215bd5-0450-4f44-8467-7e5a34585f1e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:56.134282 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 115/230] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:35:55 2022] PUT /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738/users/33317a2774e5455fa52a8ff2ac2bcbed/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:35:56.135710 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215bd5-0450-4f44-8467-7e5a34585f1e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:56.142055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561c98e-d60b-4f93-9fd7-8955840e5f47 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:56.209817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:56.211155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:56.211701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:56.212219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:56.213396 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] RBAC: Adding query filter params (role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=0388b88e9f734e8a8e7feadddec96738, user.id=4b3e9284832e456c8ca536c5583a9773) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:56.214035 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:56.215850 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:56.221289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:56.223810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 116/231] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:56 2022] GET /identity/v3/role_assignments?user.id=4b3e9284832e456c8ca536c5583a9773&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:56.357705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215bd5-0450-4f44-8467-7e5a34585f1e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:56.407833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce0fb2-f3d1-4219-bfd3-473d04d7378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:56.409069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce0fb2-f3d1-4219-bfd3-473d04d7378b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:56.409498 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce0fb2-f3d1-4219-bfd3-473d04d7378b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:56.409964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce0fb2-f3d1-4219-bfd3-473d04d7378b None admin] PATH_INFO: `/v3/users/33317a2774e5455fa52a8ff2ac2bcbed` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:56.411904 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce0fb2-f3d1-4219-bfd3-473d04d7378b None admin] RBAC: Authorizing `identity:get_user(user_id=33317a2774e5455fa52a8ff2ac2bcbed)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:56.413614 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce0fb2-f3d1-4219-bfd3-473d04d7378b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:56.415884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 116/232] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:56 2022] GET /identity/v3/users/33317a2774e5455fa52a8ff2ac2bcbed => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:56.422023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:56.531771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:56.550028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf39e-c8b2-4cdd-851c-8c8dfef20571 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:56.593320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46f67f-8c5d-4126-a67f-6dff14956810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:56.594232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46f67f-8c5d-4126-a67f-6dff14956810 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:56.594520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46f67f-8c5d-4126-a67f-6dff14956810 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:56.594802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46f67f-8c5d-4126-a67f-6dff14956810 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:56.596000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46f67f-8c5d-4126-a67f-6dff14956810 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:56.597466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46f67f-8c5d-4126-a67f-6dff14956810 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:56.599398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 117/233] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:56 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:56.605542 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce0fb2-f3d1-4219-bfd3-473d04d7378b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:56.772551 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce0fb2-f3d1-4219-bfd3-473d04d7378b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:56.775049 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:56.831425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d56af-bed1-48ee-a7de-09d39a0fd358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:56.832345 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d56af-bed1-48ee-a7de-09d39a0fd358 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:56.832636 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d56af-bed1-48ee-a7de-09d39a0fd358 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:56.832919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d56af-bed1-48ee-a7de-09d39a0fd358 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738/users/33317a2774e5455fa52a8ff2ac2bcbed/roles/7252c7aaa32c4c28b47eedca12cee086` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:56.835527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d56af-bed1-48ee-a7de-09d39a0fd358 None admin] RBAC: Authorizing `identity:create_grant(project_id=0388b88e9f734e8a8e7feadddec96738, user_id=33317a2774e5455fa52a8ff2ac2bcbed, role_id=7252c7aaa32c4c28b47eedca12cee086)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:56.837016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d56af-bed1-48ee-a7de-09d39a0fd358 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:56.858234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 117/234] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:35:56 2022] PUT /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738/users/33317a2774e5455fa52a8ff2ac2bcbed/roles/7252c7aaa32c4c28b47eedca12cee086 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:35:57.489609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e4528-3705-4600-b283-754a6607a458 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:57.490163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e4528-3705-4600-b283-754a6607a458 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:57.490271 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e4528-3705-4600-b283-754a6607a458 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:57.492105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 118/235] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:57.497535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b810-9168-4725-92c0-54b9df8f838a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:57.498100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b810-9168-4725-92c0-54b9df8f838a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:57.498587 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b810-9168-4725-92c0-54b9df8f838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:57.520660 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b5b9b810-9168-4725-92c0-54b9df8f838a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:57.522491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b5b9b810-9168-4725-92c0-54b9df8f838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:57.620919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 118/236] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:57.652482 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e4528-3705-4600-b283-754a6607a458 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:57.665768 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add870ea-6918-4699-92b6-3a6acd2bc748 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:57.666421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add870ea-6918-4699-92b6-3a6acd2bc748 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:57.666916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add870ea-6918-4699-92b6-3a6acd2bc748 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:57.669087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 119/237] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:57.675720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86e6-ede4-444e-8b54-21f1bbea1b2b None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:57.676361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86e6-ede4-444e-8b54-21f1bbea1b2b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:57.676658 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86e6-ede4-444e-8b54-21f1bbea1b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:57.702016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-0dab86e6-ede4-444e-8b54-21f1bbea1b2b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:57.703281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-0dab86e6-ede4-444e-8b54-21f1bbea1b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:57.802508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e4528-3705-4600-b283-754a6607a458 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:57.847548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 120/238] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:35:57.867837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b110-a698-4d49-aebc-562e50bb15f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:57.868848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b110-a698-4d49-aebc-562e50bb15f4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:57.869284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b110-a698-4d49-aebc-562e50bb15f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:57.869710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b110-a698-4d49-aebc-562e50bb15f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:57.871189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab86e6-ede4-444e-8b54-21f1bbea1b2b None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:57.901436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72b110-a698-4d49-aebc-562e50bb15f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:57.912358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-ef72b110-a698-4d49-aebc-562e50bb15f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:57.916609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:57.917919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:35:57.918931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:57.923986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 119/239] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:57.931040 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b110-a698-4d49-aebc-562e50bb15f4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:57.963877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:58.063054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b110-a698-4d49-aebc-562e50bb15f4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:58.066899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab86e6-ede4-444e-8b54-21f1bbea1b2b None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:58.099290 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:58.100238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:58.100672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:58.101100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:58.102034 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:58.102491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:58.104063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:58.118158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 120/240] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:58.120070 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:58.147168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a314-61ba-4d1d-8f8d-fa8b5a9f5c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:58.148027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a314-61ba-4d1d-8f8d-fa8b5a9f5c90 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:58.148266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a314-61ba-4d1d-8f8d-fa8b5a9f5c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:58.148544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a314-61ba-4d1d-8f8d-fa8b5a9f5c90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:58.150792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a314-61ba-4d1d-8f8d-fa8b5a9f5c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:58.152569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a314-61ba-4d1d-8f8d-fa8b5a9f5c90 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:58.158673 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 121/241] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:35:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:58.166725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a314-61ba-4d1d-8f8d-fa8b5a9f5c90 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:58.203730 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:58.230869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4ce25-9e24-446e-8ddb-de47327f1518 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:58.307032 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a3595-fab0-4196-b49a-13abe9459c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:58.307925 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3595-fab0-4196-b49a-13abe9459c9c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:58.308744 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3595-fab0-4196-b49a-13abe9459c9c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:58.309057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3595-fab0-4196-b49a-13abe9459c9c None admin] PATH_INFO: `/v3/users/288955562be44df8b10c75f6b856b872` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:58.318305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:58.330393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a314-61ba-4d1d-8f8d-fa8b5a9f5c90 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:58.358501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a3595-fab0-4196-b49a-13abe9459c9c None admin] RBAC: Authorizing `identity:get_user(user_id=288955562be44df8b10c75f6b856b872)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:58.359994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a3595-fab0-4196-b49a-13abe9459c9c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:58.362161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 121/242] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:58 2022] GET /identity/v3/users/288955562be44df8b10c75f6b856b872 => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:58.367249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f67af5-e1c6-4b0b-b5e3-ff6f8f3031f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:58.367820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a3595-fab0-4196-b49a-13abe9459c9c None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:58.367930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f67af5-e1c6-4b0b-b5e3-ff6f8f3031f4 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:58.368194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f67af5-e1c6-4b0b-b5e3-ff6f8f3031f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:58.368476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f67af5-e1c6-4b0b-b5e3-ff6f8f3031f4 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:58.369196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f67af5-e1c6-4b0b-b5e3-ff6f8f3031f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:58.371246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f67af5-e1c6-4b0b-b5e3-ff6f8f3031f4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:58.413126 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 122/243] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:35:58 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:35:58.496442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a3595-fab0-4196-b49a-13abe9459c9c None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:58.531439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:58.537620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a1098-9b16-4c2e-b484-d0df690adb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:58.538345 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1098-9b16-4c2e-b484-d0df690adb49 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:58.538635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1098-9b16-4c2e-b484-d0df690adb49 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:58.539933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1098-9b16-4c2e-b484-d0df690adb49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:58.622111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a1098-9b16-4c2e-b484-d0df690adb49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:58.624902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a1098-9b16-4c2e-b484-d0df690adb49 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:58.737090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 122/244] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:35:58.742851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f67af5-e1c6-4b0b-b5e3-ff6f8f3031f4 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:58.776456 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e74b5-872f-4e91-a4b3-faf2af04053f None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:58.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e74b5-872f-4e91-a4b3-faf2af04053f None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:58.777263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e74b5-872f-4e91-a4b3-faf2af04053f None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:58.779551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 123/245] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:35:58.790400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316d24-5082-42de-96f4-70cb413693d7 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:58.790943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316d24-5082-42de-96f4-70cb413693d7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:58.791379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316d24-5082-42de-96f4-70cb413693d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:58.820263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b4316d24-5082-42de-96f4-70cb413693d7 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:58.821499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b4316d24-5082-42de-96f4-70cb413693d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:58.857046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:58.877383 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f67af5-e1c6-4b0b-b5e3-ff6f8f3031f4 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:58.909484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 124/246] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:58.924833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80377a06-136f-4483-972a-2e0f229d0de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:58.925715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377a06-136f-4483-972a-2e0f229d0de3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:58.926051 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377a06-136f-4483-972a-2e0f229d0de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:58.926337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80377a06-136f-4483-972a-2e0f229d0de3 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:58.927583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80377a06-136f-4483-972a-2e0f229d0de3 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:58.929051 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80377a06-136f-4483-972a-2e0f229d0de3 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:58.930849 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 123/247] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:35:58 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:58.936937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80377a06-136f-4483-972a-2e0f229d0de3 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:58.937195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4316d24-5082-42de-96f4-70cb413693d7 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:58.964068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:59.069179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4316d24-5082-42de-96f4-70cb413693d7 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:59.073171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80377a06-136f-4483-972a-2e0f229d0de3 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:59.115412 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f13e0-3a5a-4d0f-a83e-10bfa3226354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:59.116222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f13e0-3a5a-4d0f-a83e-10bfa3226354 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.116547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f13e0-3a5a-4d0f-a83e-10bfa3226354 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.116785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f13e0-3a5a-4d0f-a83e-10bfa3226354 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:59.117710 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac93ae-a4af-4419-a474-34b8be843e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:59.118399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac93ae-a4af-4419-a474-34b8be843e3c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.118689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac93ae-a4af-4419-a474-34b8be843e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.118965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac93ae-a4af-4419-a474-34b8be843e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:59.119801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac93ae-a4af-4419-a474-34b8be843e3c None admin] RBAC: Adding query filter params (role.id=acb61715c6f849fca1c8d329abea7b1d, scope.project.id=0388b88e9f734e8a8e7feadddec96738, user.id=288955562be44df8b10c75f6b856b872) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:59.120117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac93ae-a4af-4419-a474-34b8be843e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:59.121615 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac93ae-a4af-4419-a474-34b8be843e3c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:59.130813 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 124/248] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:35:58 2022] GET /identity/v3/role_assignments?user.id=288955562be44df8b10c75f6b856b872&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=acb61715c6f849fca1c8d329abea7b1d => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:59.130977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f13e0-3a5a-4d0f-a83e-10bfa3226354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:59.131532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150410-848d-49ea-a1db-d0b0df9e4a75 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.131827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150410-848d-49ea-a1db-d0b0df9e4a75 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.132104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150410-848d-49ea-a1db-d0b0df9e4a75 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:59.133473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 125/249] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:35:59.139238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7ddf-c06b-4639-8bb9-04b45ca2c16e None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.139835 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7ddf-c06b-4639-8bb9-04b45ca2c16e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.140314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7ddf-c06b-4639-8bb9-04b45ca2c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-a94f13e0-3a5a-4d0f-a83e-10bfa3226354 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:59.146123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:59.147158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:35:59.147964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 125/250] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:59.154117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f13e0-3a5a-4d0f-a83e-10bfa3226354 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:59.165536 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-017b7ddf-c06b-4639-8bb9-04b45ca2c16e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:35:59.167305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-017b7ddf-c06b-4639-8bb9-04b45ca2c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:35:59.192897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:59.255106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 126/251] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:35:59.279295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b7ddf-c06b-4639-8bb9-04b45ca2c16e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:59.297383 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:59.317218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f13e0-3a5a-4d0f-a83e-10bfa3226354 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:59.385600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:59.387199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.387661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.388090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:59.389009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:59.389455 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:59.391203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:59.408300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 126/252] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:59.416011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:59.474925 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b7ddf-c06b-4639-8bb9-04b45ca2c16e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:59.547109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eead23-c141-40d5-8174-6487261df1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:59.547921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eead23-c141-40d5-8174-6487261df1de None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.548207 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eead23-c141-40d5-8174-6487261df1de None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.548485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eead23-c141-40d5-8174-6487261df1de None admin] PATH_INFO: `/v3/roles/member` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:59.573206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eead23-c141-40d5-8174-6487261df1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:35:59.575879 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-59eead23-c141-40d5-8174-6487261df1de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:35:59.584103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:35:59.585583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:35:59.586419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:35:59.589202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 127/253] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:35:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:35:59.595995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eead23-c141-40d5-8174-6487261df1de None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:59.622203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852631c-d15d-46dd-b631-b28c6bd93580 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:59.705724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e2d02-52d3-477e-b1c5-df543992dbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:59.706674 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e2d02-52d3-477e-b1c5-df543992dbf1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.706963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e2d02-52d3-477e-b1c5-df543992dbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.707244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e2d02-52d3-477e-b1c5-df543992dbf1 None admin] PATH_INFO: `/v3/users/33317a2774e5455fa52a8ff2ac2bcbed` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:59.708616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e2d02-52d3-477e-b1c5-df543992dbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=33317a2774e5455fa52a8ff2ac2bcbed)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:59.710500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e2d02-52d3-477e-b1c5-df543992dbf1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:59.717879 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 127/254] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:59 2022] GET /identity/v3/users/33317a2774e5455fa52a8ff2ac2bcbed => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:35:59.718912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e2d02-52d3-477e-b1c5-df543992dbf1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:59.754097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:35:59.840609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eead23-c141-40d5-8174-6487261df1de None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:59.913364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e2d02-52d3-477e-b1c5-df543992dbf1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:35:59.926156 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:59.926860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.927153 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.927437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:35:59.928202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:35:59.928676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:35:59.932710 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:35:59.953920 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 128/255] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:35:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:35:59.956850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:35:59.982697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7a26f-4793-4bfa-8deb-56906a27812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:35:59.983374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a26f-4793-4bfa-8deb-56906a27812d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:35:59.983663 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a26f-4793-4bfa-8deb-56906a27812d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:35:59.983945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a26f-4793-4bfa-8deb-56906a27812d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.025291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:00.064891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655dc99-420d-40b2-b98a-6a91ff528f27 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:00.095441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:00.100961 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be4f87-698a-4a38-825c-bcd483cd0c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:00.101465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7a26f-4793-4bfa-8deb-56906a27812d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:00.101949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be4f87-698a-4a38-825c-bcd483cd0c05 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.102239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be4f87-698a-4a38-825c-bcd483cd0c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.102522 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be4f87-698a-4a38-825c-bcd483cd0c05 None admin] PATH_INFO: `/v3/users/4b3e9284832e456c8ca536c5583a9773` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.103065 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7a26f-4793-4bfa-8deb-56906a27812d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:00.104801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be4f87-698a-4a38-825c-bcd483cd0c05 None admin] RBAC: Authorizing `identity:get_user(user_id=4b3e9284832e456c8ca536c5583a9773)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:00.106915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be4f87-698a-4a38-825c-bcd483cd0c05 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:00.108985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 129/256] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:35:59 2022] GET /identity/v3/users/4b3e9284832e456c8ca536c5583a9773 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:00.114031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be4f87-698a-4a38-825c-bcd483cd0c05 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:00.221306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be4f87-698a-4a38-825c-bcd483cd0c05 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:00.257722 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e95d82-f063-4b20-bd38-ab32e5de4ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:00.258691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e95d82-f063-4b20-bd38-ab32e5de4ceb None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.258986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e95d82-f063-4b20-bd38-ab32e5de4ceb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.259272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e95d82-f063-4b20-bd38-ab32e5de4ceb None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.260476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e95d82-f063-4b20-bd38-ab32e5de4ceb None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:00.262051 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e95d82-f063-4b20-bd38-ab32e5de4ceb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:00.264082 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 130/257] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:00 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:00.265367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b8908-2f8d-477c-8464-8caf6a00c011 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.265716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b8908-2f8d-477c-8464-8caf6a00c011 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.266039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b8908-2f8d-477c-8464-8caf6a00c011 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.267284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 131/258] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:00.270210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b8908-2f8d-477c-8464-8caf6a00c011 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:00.282772 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 128/259] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:00.288074 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46b93-5c50-4da8-9af2-64389479ae28 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.288372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46b93-5c50-4da8-9af2-64389479ae28 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.288661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46b93-5c50-4da8-9af2-64389479ae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.322755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-e2e46b93-5c50-4da8-9af2-64389479ae28 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:00.324083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-e2e46b93-5c50-4da8-9af2-64389479ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:00.346010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:00.385082 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b8908-2f8d-477c-8464-8caf6a00c011 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:00.419818 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:00.424924 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f741-3119-45f4-be08-c476e9b62562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:00.425867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f741-3119-45f4-be08-c476e9b62562 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.426160 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f741-3119-45f4-be08-c476e9b62562 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.426438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f741-3119-45f4-be08-c476e9b62562 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738/users/4b3e9284832e456c8ca536c5583a9773/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.429167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202f741-3119-45f4-be08-c476e9b62562 None admin] RBAC: Authorizing `identity:create_grant(project_id=0388b88e9f734e8a8e7feadddec96738, user_id=4b3e9284832e456c8ca536c5583a9773, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:00.430745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202f741-3119-45f4-be08-c476e9b62562 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:00.447069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 132/260] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:36:00 2022] PUT /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738/users/4b3e9284832e456c8ca536c5583a9773/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:00.448261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f741-3119-45f4-be08-c476e9b62562 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:00.463970 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 129/261] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:00.495038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e46b93-5c50-4da8-9af2-64389479ae28 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:00.589882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f741-3119-45f4-be08-c476e9b62562 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:00.626944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e46b93-5c50-4da8-9af2-64389479ae28 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:00.642455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:00.660079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4e5b2-df61-4eaf-9f59-7e0fc34ba1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:00.661089 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4e5b2-df61-4eaf-9f59-7e0fc34ba1b6 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.661432 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4e5b2-df61-4eaf-9f59-7e0fc34ba1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.661722 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4e5b2-df61-4eaf-9f59-7e0fc34ba1b6 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.668047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4e5b2-df61-4eaf-9f59-7e0fc34ba1b6 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:00.670227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4e5b2-df61-4eaf-9f59-7e0fc34ba1b6 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:00.672555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 133/262] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:00 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:00.673999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d278c-0dde-4686-9673-104b22280514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:00.674995 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d278c-0dde-4686-9673-104b22280514 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.675433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d278c-0dde-4686-9673-104b22280514 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.675860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d278c-0dde-4686-9673-104b22280514 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.678758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4e5b2-df61-4eaf-9f59-7e0fc34ba1b6 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:00.687957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d278c-0dde-4686-9673-104b22280514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-de4d278c-0dde-4686-9673-104b22280514 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:00.696612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:00.697918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:00.698993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:00.700998 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 130/263] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:36:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:00.706856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d278c-0dde-4686-9673-104b22280514 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:00.754246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:00.818317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d278c-0dde-4686-9673-104b22280514 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:00.854912 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4e5b2-df61-4eaf-9f59-7e0fc34ba1b6 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:00.856432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:00.857309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.857778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.858215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.859126 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:00.859584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:00.861166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:00.870005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 131/264] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:00.875758 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:00.904398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:00.905216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:00.905372 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:00.905663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:00.906561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=0388b88e9f734e8a8e7feadddec96738, user.id=33317a2774e5455fa52a8ff2ac2bcbed) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:00.906932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:00.908412 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:00.919972 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 134/265] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:00 2022] GET /identity/v3/role_assignments?user.id=33317a2774e5455fa52a8ff2ac2bcbed&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:00.992201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e8ff7-1a3e-44c8-a66f-b49bff8d95c0 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:00.995959 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:01.031288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ab986-524f-46ce-9789-a5d2a203e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:01.032455 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab986-524f-46ce-9789-a5d2a203e486 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:01.032912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab986-524f-46ce-9789-a5d2a203e486 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:01.033341 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab986-524f-46ce-9789-a5d2a203e486 None admin] PATH_INFO: `/v3/users/33317a2774e5455fa52a8ff2ac2bcbed` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:01.034912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ab986-524f-46ce-9789-a5d2a203e486 None admin] RBAC: Authorizing `identity:get_user(user_id=33317a2774e5455fa52a8ff2ac2bcbed)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:01.036607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ab986-524f-46ce-9789-a5d2a203e486 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:01.038557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 132/266] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:00 2022] GET /identity/v3/users/33317a2774e5455fa52a8ff2ac2bcbed => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:01.044420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:01.144681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:01.193676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c2fa-e5c4-4df6-9784-eff4a9564e16 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:01.231158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81f34c-ca20-4680-84bb-3022cf3bf9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:01.231828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f34c-ca20-4680-84bb-3022cf3bf9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:01.232117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f34c-ca20-4680-84bb-3022cf3bf9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:01.232399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f34c-ca20-4680-84bb-3022cf3bf9c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:01.305309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81f34c-ca20-4680-84bb-3022cf3bf9c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:01.306754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81f34c-ca20-4680-84bb-3022cf3bf9c0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:01.368358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:01.414899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 135/267] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:01.420508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ab986-524f-46ce-9789-a5d2a203e486 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:01.533405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ab986-524f-46ce-9789-a5d2a203e486 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:01.573085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca20ec-f69a-43ad-b2cc-33cc65d2ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:01.574363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca20ec-f69a-43ad-b2cc-33cc65d2ce65 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:01.574901 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca20ec-f69a-43ad-b2cc-33cc65d2ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:01.575380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca20ec-f69a-43ad-b2cc-33cc65d2ce65 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:01.576824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca20ec-f69a-43ad-b2cc-33cc65d2ce65 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:01.578528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca20ec-f69a-43ad-b2cc-33cc65d2ce65 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:01.580783 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 133/268] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:01 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:01.587046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81f34c-ca20-4680-84bb-3022cf3bf9c0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:01.700854 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81f34c-ca20-4680-84bb-3022cf3bf9c0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:01.737587 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96089dd-eaae-4ee3-84c5-b166ed7c9a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:01.738705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96089dd-eaae-4ee3-84c5-b166ed7c9a79 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:01.739198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96089dd-eaae-4ee3-84c5-b166ed7c9a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:01.739753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96089dd-eaae-4ee3-84c5-b166ed7c9a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:01.740790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96089dd-eaae-4ee3-84c5-b166ed7c9a79 None admin] RBAC: Adding query filter params (role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=0388b88e9f734e8a8e7feadddec96738, user.id=33317a2774e5455fa52a8ff2ac2bcbed) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:01.741307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96089dd-eaae-4ee3-84c5-b166ed7c9a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:01.743012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96089dd-eaae-4ee3-84c5-b166ed7c9a79 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:01.750013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 136/269] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:01 2022] GET /identity/v3/role_assignments?user.id=33317a2774e5455fa52a8ff2ac2bcbed&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:02.058893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e5fa-b54c-4d98-96bc-1d397426e9e4 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.059436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e5fa-b54c-4d98-96bc-1d397426e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.059515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e5fa-b54c-4d98-96bc-1d397426e9e4 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.061182 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 134/270] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:02.067323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857bfc2-e539-4d64-af13-fbc4457bb412 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.067755 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857bfc2-e539-4d64-af13-fbc4457bb412 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.067932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857bfc2-e539-4d64-af13-fbc4457bb412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.086573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-7857bfc2-e539-4d64-af13-fbc4457bb412 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:02.087778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-7857bfc2-e539-4d64-af13-fbc4457bb412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:02.107818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:02.140181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d045-68b3-4875-a8d1-34cfd0ee6e22 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.140498 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d045-68b3-4875-a8d1-34cfd0ee6e22 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.140751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d045-68b3-4875-a8d1-34cfd0ee6e22 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.142407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 135/271] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:36:02.148192 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482754a-c6b8-4859-956c-fa6f7a256544 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.148538 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482754a-c6b8-4859-956c-fa6f7a256544 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.148775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482754a-c6b8-4859-956c-fa6f7a256544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.170274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-f482754a-c6b8-4859-956c-fa6f7a256544 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:02.171517 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f482754a-c6b8-4859-956c-fa6f7a256544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:02.177293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 137/272] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:02.209656 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857bfc2-e539-4d64-af13-fbc4457bb412 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:02.217191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:02.265872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 136/273] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:02.288022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482754a-c6b8-4859-956c-fa6f7a256544 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:02.338789 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857bfc2-e539-4d64-af13-fbc4457bb412 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:02.381541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18223a8e-7c2f-4b1a-a428-a980329fba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:02.382629 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223a8e-7c2f-4b1a-a428-a980329fba28 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.382629 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223a8e-7c2f-4b1a-a428-a980329fba28 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.382910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223a8e-7c2f-4b1a-a428-a980329fba28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.393852 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18223a8e-7c2f-4b1a-a428-a980329fba28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-18223a8e-7c2f-4b1a-a428-a980329fba28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:02.401431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:02.403251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:02.404062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 138/274] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:02.405016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd862-1845-4281-a857-afbeaf39c56e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.405016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd862-1845-4281-a857-afbeaf39c56e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.405016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd862-1845-4281-a857-afbeaf39c56e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.406499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 139/275] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:02.408801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd862-1845-4281-a857-afbeaf39c56e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:02.418894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482754a-c6b8-4859-956c-fa6f7a256544 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:02.429859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:02.459571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e1230-f3c4-45a7-a8cd-0100f1bb15c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:02.460622 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1230-f3c4-45a7-a8cd-0100f1bb15c9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.460909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1230-f3c4-45a7-a8cd-0100f1bb15c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.461184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1230-f3c4-45a7-a8cd-0100f1bb15c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.462382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e1230-f3c4-45a7-a8cd-0100f1bb15c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:02.463838 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e1230-f3c4-45a7-a8cd-0100f1bb15c9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:02.466049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 137/276] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:02.470657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e8c-0862-4b15-a423-b0d702cf34de None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.470657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e8c-0862-4b15-a423-b0d702cf34de None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.470657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e8c-0862-4b15-a423-b0d702cf34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.485461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-24f06e8c-0862-4b15-a423-b0d702cf34de None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:02.486658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-24f06e8c-0862-4b15-a423-b0d702cf34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:02.521658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:02.528711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd862-1845-4281-a857-afbeaf39c56e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:02.562862 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 138/277] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:02.563523 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e8c-0862-4b15-a423-b0d702cf34de None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:02.563849 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:02.564530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.564822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.565105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.565886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:02.566221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:02.567636 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:02.583381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 140/278] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:02.584611 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:02.669552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:02.679401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e8c-0862-4b15-a423-b0d702cf34de None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:02.695175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761122ec-548f-4322-8035-dcc9a2b89896 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:02.717216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48d7b-56fc-4449-b952-ed186dbe84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:02.718168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48d7b-56fc-4449-b952-ed186dbe84f8 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.718750 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48d7b-56fc-4449-b952-ed186dbe84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.719299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48d7b-56fc-4449-b952-ed186dbe84f8 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.720075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48d7b-56fc-4449-b952-ed186dbe84f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:02.721653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48d7b-56fc-4449-b952-ed186dbe84f8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:02.729580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a839e0-f8be-499d-9c1d-2988b40a2635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:02.730439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a839e0-f8be-499d-9c1d-2988b40a2635 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.730883 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a839e0-f8be-499d-9c1d-2988b40a2635 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.731330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a839e0-f8be-499d-9c1d-2988b40a2635 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.742453 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a839e0-f8be-499d-9c1d-2988b40a2635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:02.744362 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 139/279] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:36:02 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:36:02.745099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48d7b-56fc-4449-b952-ed186dbe84f8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-c4a839e0-f8be-499d-9c1d-2988b40a2635 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:02.751036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:02.752039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:02.758208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 141/280] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:02.763062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a839e0-f8be-499d-9c1d-2988b40a2635 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:02.787186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:02.881790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48d7b-56fc-4449-b952-ed186dbe84f8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:02.892569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a839e0-f8be-499d-9c1d-2988b40a2635 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:02.923282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049febae-bec2-4000-bc96-5323de653fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:02.924237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049febae-bec2-4000-bc96-5323de653fc7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.924628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049febae-bec2-4000-bc96-5323de653fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.925014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049febae-bec2-4000-bc96-5323de653fc7 None admin] PATH_INFO: `/v3/users/2c34c92d269c45ef972a345c88e142e7` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.942800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:02.943506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:02.943778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:02.944061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:02.944819 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:02.945130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:02.946523 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049febae-bec2-4000-bc96-5323de653fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=2c34c92d269c45ef972a345c88e142e7)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:02.946633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:02.948215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049febae-bec2-4000-bc96-5323de653fc7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:02.949685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:02.951273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 140/281] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:02 2022] GET /identity/v3/users/2c34c92d269c45ef972a345c88e142e7 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:02.957694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049febae-bec2-4000-bc96-5323de653fc7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:02.967961 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 142/282] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:02.969919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:03.074654 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:03.089364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049febae-bec2-4000-bc96-5323de653fc7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:03.107578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b35d3-141e-49b4-b497-8b0e91e938bc None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:03.136552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:03.137526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:03.137988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:03.138489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:03.139173 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] RBAC: Adding query filter params (role.id=6076bee6c25b4df5bfbd3f00b06c314b, user.id=2c34c92d269c45ef972a345c88e142e7, scope.system=all) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:03.139478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:03.140999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:03.149046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 141/283] 10.222.0.13 () {56 vars in 1308 bytes} [Wed May 25 13:36:02 2022] GET /identity/v3/role_assignments?user.id=2c34c92d269c45ef972a345c88e142e7&scope.system=all&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:03.158447 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac748d-2d7a-49af-9973-1280e9490b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:03.159413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac748d-2d7a-49af-9973-1280e9490b49 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:03.159707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac748d-2d7a-49af-9973-1280e9490b49 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:03.159986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac748d-2d7a-49af-9973-1280e9490b49 None admin] PATH_INFO: `/v3/users/288955562be44df8b10c75f6b856b872` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:03.161277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac748d-2d7a-49af-9973-1280e9490b49 None admin] RBAC: Authorizing `identity:get_user(user_id=288955562be44df8b10c75f6b856b872)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:03.162894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac748d-2d7a-49af-9973-1280e9490b49 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:03.164994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 143/284] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:02 2022] GET /identity/v3/users/288955562be44df8b10c75f6b856b872 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:03.171158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:03.286012 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34290fc1-30ac-48b6-8d29-4ee2a3e069e9 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:03.324492 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcb6a7-eb02-4fb7-aac0-5000ae3930c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:03.325378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb6a7-eb02-4fb7-aac0-5000ae3930c6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:03.325661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb6a7-eb02-4fb7-aac0-5000ae3930c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:03.325974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb6a7-eb02-4fb7-aac0-5000ae3930c6 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:03.327259 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcb6a7-eb02-4fb7-aac0-5000ae3930c6 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:03.328754 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcb6a7-eb02-4fb7-aac0-5000ae3930c6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:03.330924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 142/285] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:03 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:03.337158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac748d-2d7a-49af-9973-1280e9490b49 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:03.411946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:03.448431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac748d-2d7a-49af-9973-1280e9490b49 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:03.485691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca254bc-17fe-4138-bac6-487ec6c41843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:03.486621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca254bc-17fe-4138-bac6-487ec6c41843 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:03.486908 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca254bc-17fe-4138-bac6-487ec6c41843 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:03.487187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca254bc-17fe-4138-bac6-487ec6c41843 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738/users/288955562be44df8b10c75f6b856b872/roles/acb61715c6f849fca1c8d329abea7b1d` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:03.489204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca254bc-17fe-4138-bac6-487ec6c41843 None admin] RBAC: Authorizing `identity:create_grant(project_id=0388b88e9f734e8a8e7feadddec96738, user_id=288955562be44df8b10c75f6b856b872, role_id=acb61715c6f849fca1c8d329abea7b1d)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:03.490712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca254bc-17fe-4138-bac6-487ec6c41843 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:03.508021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 144/286] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:36:03 2022] PUT /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738/users/288955562be44df8b10c75f6b856b872/roles/acb61715c6f849fca1c8d329abea7b1d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:03.549426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8bc26-f8de-4c07-8fea-8361e9dc9d08 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:03.549705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8bc26-f8de-4c07-8fea-8361e9dc9d08 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:03.549961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8bc26-f8de-4c07-8fea-8361e9dc9d08 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:03.551607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 143/287] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:36:03.557258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aadec-0833-4c31-8872-6472c99db6f3 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:03.557571 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aadec-0833-4c31-8872-6472c99db6f3 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:03.557861 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aadec-0833-4c31-8872-6472c99db6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:03.576110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-749aadec-0833-4c31-8872-6472c99db6f3 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:03.577396 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-749aadec-0833-4c31-8872-6472c99db6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:03.672370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 145/288] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:03.710883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8bc26-f8de-4c07-8fea-8361e9dc9d08 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:03.733777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:03.871504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8bc26-f8de-4c07-8fea-8361e9dc9d08 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:03.928654 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fb04f-a4f0-4970-87cc-0243284b1431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:03.929480 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fb04f-a4f0-4970-87cc-0243284b1431 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:03.929820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fb04f-a4f0-4970-87cc-0243284b1431 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:03.930109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fb04f-a4f0-4970-87cc-0243284b1431 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:03.947583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fb04f-a4f0-4970-87cc-0243284b1431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4e7fb04f-a4f0-4970-87cc-0243284b1431 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:03.956015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:03.956972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:03.957856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 144/289] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:03.963588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aadec-0833-4c31-8872-6472c99db6f3 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:04.028092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:04.075625 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aadec-0833-4c31-8872-6472c99db6f3 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:04.124533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:04.125146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:04.125417 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:04.125700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:04.126543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:04.126858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:04.128323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:04.141793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 146/290] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:04.147423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fb04f-a4f0-4970-87cc-0243284b1431 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:04.243793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:04.273986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fb04f-a4f0-4970-87cc-0243284b1431 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:04.327865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a82d7c-ca43-4e03-8dbb-780b4ece38b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:04.328762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a82d7c-ca43-4e03-8dbb-780b4ece38b4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:04.329054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a82d7c-ca43-4e03-8dbb-780b4ece38b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:04.329337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a82d7c-ca43-4e03-8dbb-780b4ece38b4 None admin] PATH_INFO: `/v3/users/4b3e9284832e456c8ca536c5583a9773` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:04.330684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a82d7c-ca43-4e03-8dbb-780b4ece38b4 None admin] RBAC: Authorizing `identity:get_user(user_id=4b3e9284832e456c8ca536c5583a9773)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:04.332214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a82d7c-ca43-4e03-8dbb-780b4ece38b4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:04.334239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 145/291] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:04 2022] GET /identity/v3/users/4b3e9284832e456c8ca536c5583a9773 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:04.339986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:04.447615 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be42c3-0b3d-47a3-8841-2e895519fe6d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:04.474350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:04.500584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9711c-85f0-453f-8ab5-c64dbd34edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:04.501244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9711c-85f0-453f-8ab5-c64dbd34edaf None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:04.501543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9711c-85f0-453f-8ab5-c64dbd34edaf None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:04.501849 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9711c-85f0-453f-8ab5-c64dbd34edaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:04.601214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9711c-85f0-453f-8ab5-c64dbd34edaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:04.603123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9711c-85f0-453f-8ab5-c64dbd34edaf None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:04.738145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 147/292] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:04.743640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a82d7c-ca43-4e03-8dbb-780b4ece38b4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:04.873464 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a82d7c-ca43-4e03-8dbb-780b4ece38b4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:04.908549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63330d-e999-43bd-b4eb-fee2201fe84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:04.909413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63330d-e999-43bd-b4eb-fee2201fe84b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:04.909695 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63330d-e999-43bd-b4eb-fee2201fe84b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:04.909997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63330d-e999-43bd-b4eb-fee2201fe84b None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:04.911197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63330d-e999-43bd-b4eb-fee2201fe84b None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:04.912642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63330d-e999-43bd-b4eb-fee2201fe84b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:04.914692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 146/293] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:04 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:04.923034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9711c-85f0-453f-8ab5-c64dbd34edaf None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:04.966875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:05.094722 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9711c-85f0-453f-8ab5-c64dbd34edaf None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:05.151900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490843b-b15b-4eb8-acdd-650eecea503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:05.153287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490843b-b15b-4eb8-acdd-650eecea503d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:05.153724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490843b-b15b-4eb8-acdd-650eecea503d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:05.154167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490843b-b15b-4eb8-acdd-650eecea503d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:05.155156 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490843b-b15b-4eb8-acdd-650eecea503d None admin] RBAC: Adding query filter params (role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=0388b88e9f734e8a8e7feadddec96738, user.id=4b3e9284832e456c8ca536c5583a9773) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:05.155613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490843b-b15b-4eb8-acdd-650eecea503d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:05.157247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490843b-b15b-4eb8-acdd-650eecea503d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:05.166702 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 148/294] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:04 2022] GET /identity/v3/role_assignments?user.id=4b3e9284832e456c8ca536c5583a9773&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:05.569884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996df6-8af7-4422-8c70-76bdeb49fadf None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:05.570913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996df6-8af7-4422-8c70-76bdeb49fadf None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:05.571425 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996df6-8af7-4422-8c70-76bdeb49fadf None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:05.573315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 147/295] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:05.579137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5da7-1c97-4253-8172-d27c8610fc03 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:05.579711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5da7-1c97-4253-8172-d27c8610fc03 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:05.580194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5da7-1c97-4253-8172-d27c8610fc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:05.602004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-5ebc5da7-1c97-4253-8172-d27c8610fc03 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:05.603547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-5ebc5da7-1c97-4253-8172-d27c8610fc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:05.702700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 149/296] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:05.730530 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2996df6-8af7-4422-8c70-76bdeb49fadf None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:05.753222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:05.861543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2996df6-8af7-4422-8c70-76bdeb49fadf None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:05.869041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed2c9-874e-4ae1-87b6-b95e0d2eda63 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:05.869677 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed2c9-874e-4ae1-87b6-b95e0d2eda63 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:05.870202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed2c9-874e-4ae1-87b6-b95e0d2eda63 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:05.872374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 150/297] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:05.877713 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45e0c-5e69-4b54-b5e6-eceae4902a84 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:05.878317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45e0c-5e69-4b54-b5e6-eceae4902a84 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:05.878803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45e0c-5e69-4b54-b5e6-eceae4902a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:05.896004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-71c45e0c-5e69-4b54-b5e6-eceae4902a84 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:05.896280 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb337f7-6e17-4ab3-b594-7ad5c4eb02fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:05.896991 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb337f7-6e17-4ab3-b594-7ad5c4eb02fc None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:05.897274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb337f7-6e17-4ab3-b594-7ad5c4eb02fc None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:05.897548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb337f7-6e17-4ab3-b594-7ad5c4eb02fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:05.898553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-71c45e0c-5e69-4b54-b5e6-eceae4902a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:05.908686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb337f7-6e17-4ab3-b594-7ad5c4eb02fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:05.914554 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-cbb337f7-6e17-4ab3-b594-7ad5c4eb02fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:05.916515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:05.917982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:05.919238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 148/298] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:05.919916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa812e-9bf6-4045-9339-fb2db5d8ac5e None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:05.920111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa812e-9bf6-4045-9339-fb2db5d8ac5e None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:05.920393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa812e-9bf6-4045-9339-fb2db5d8ac5e None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:05.922002 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 149/299] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:05.925669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa812e-9bf6-4045-9339-fb2db5d8ac5e None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:05.975774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 151/300] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:05.981944 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25210-6975-433d-8f7a-ec5b263d5069 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:05.981944 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25210-6975-433d-8f7a-ec5b263d5069 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:05.981944 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25210-6975-433d-8f7a-ec5b263d5069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.000968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-e3a25210-6975-433d-8f7a-ec5b263d5069 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:06.002196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e3a25210-6975-433d-8f7a-ec5b263d5069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:06.009946 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:06.043662 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa812e-9bf6-4045-9339-fb2db5d8ac5e None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.079118 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 152/301] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:06.080249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a25210-6975-433d-8f7a-ec5b263d5069 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.081801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.082642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.083263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.083620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.085657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:06.086075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:06.087549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:06.101195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 150/302] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:06.106531 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.157274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:06.188624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a25210-6975-433d-8f7a-ec5b263d5069 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.223837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f6eff-c081-4b7a-9af0-afd89ed43712 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.225270 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e1f1f-93b0-45ba-872e-5af9e229d4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.226104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e1f1f-93b0-45ba-872e-5af9e229d4d2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.226390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e1f1f-93b0-45ba-872e-5af9e229d4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.226667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e1f1f-93b0-45ba-872e-5af9e229d4d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.237486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e1f1f-93b0-45ba-872e-5af9e229d4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-2d2e1f1f-93b0-45ba-872e-5af9e229d4d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:06.245143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:06.246395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 153/303] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:06.247263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e1f1f-93b0-45ba-872e-5af9e229d4d2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.262991 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:06.269414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10ce03-b1d9-471f-86f9-dba895e7cb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.270511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ce03-b1d9-471f-86f9-dba895e7cb11 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.270896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ce03-b1d9-471f-86f9-dba895e7cb11 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.271118 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ce03-b1d9-471f-86f9-dba895e7cb11 None admin] PATH_INFO: `/v3/users/afd00513c7404cc3a8aca9a424ed099f` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.286494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10ce03-b1d9-471f-86f9-dba895e7cb11 None admin] RBAC: Authorizing `identity:get_user(user_id=afd00513c7404cc3a8aca9a424ed099f)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:06.287950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10ce03-b1d9-471f-86f9-dba895e7cb11 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:06.289882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 151/304] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:06 2022] GET /identity/v3/users/afd00513c7404cc3a8aca9a424ed099f => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:06.295045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10ce03-b1d9-471f-86f9-dba895e7cb11 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.359567 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e1f1f-93b0-45ba-872e-5af9e229d4d2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.390479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:06.396937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27dbb-6cd1-4f12-8bb0-11aa940dfaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.397757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27dbb-6cd1-4f12-8bb0-11aa940dfaba None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.398092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27dbb-6cd1-4f12-8bb0-11aa940dfaba None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.398374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27dbb-6cd1-4f12-8bb0-11aa940dfaba None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.399557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27dbb-6cd1-4f12-8bb0-11aa940dfaba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:06.400037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10ce03-b1d9-471f-86f9-dba895e7cb11 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.401036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27dbb-6cd1-4f12-8bb0-11aa940dfaba None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:06.403558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 154/305] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:06.404104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27dbb-6cd1-4f12-8bb0-11aa940dfaba None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.440727 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.441380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.441668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.441976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.442728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] RBAC: Adding query filter params (name=member) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:06.443037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:06.444415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:06.453664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 152/306] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:06.453664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.515911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:06.516208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27dbb-6cd1-4f12-8bb0-11aa940dfaba None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.550212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.550891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.551180 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.551462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.552297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] RBAC: Adding query filter params (role.id=acb61715c6f849fca1c8d329abea7b1d, user.id=afd00513c7404cc3a8aca9a424ed099f, scope.system=all) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:06.552613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:06.554151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:06.569769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 155/307] 10.222.0.13 () {56 vars in 1308 bytes} [Wed May 25 13:36:06 2022] GET /identity/v3/role_assignments?user.id=afd00513c7404cc3a8aca9a424ed099f&scope.system=all&role.id=acb61715c6f849fca1c8d329abea7b1d => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:06.569769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.578275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74e640-027a-4fb9-94e2-b619ee5622eb None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.616885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe7951-0f89-4143-99aa-766761da9297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.617563 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7951-0f89-4143-99aa-766761da9297 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.617899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7951-0f89-4143-99aa-766761da9297 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.618181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7951-0f89-4143-99aa-766761da9297 None admin] PATH_INFO: `/v3/groups` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.618895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe7951-0f89-4143-99aa-766761da9297 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:06.620897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe7951-0f89-4143-99aa-766761da9297 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:06.642533 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 153/308] 10.222.0.13 () {60 vars in 1134 bytes} [Wed May 25 13:36:06 2022] POST /identity/v3/groups => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:36:06.654601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:06.671435 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a55d3-edc2-42a4-9fc1-0bd9384f0e4a None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.671760 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a55d3-edc2-42a4-9fc1-0bd9384f0e4a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.672015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a55d3-edc2-42a4-9fc1-0bd9384f0e4a None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.673779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 154/309] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:36:06.679898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522d086-17fb-4c06-9110-37ebc94b9bd5 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.680470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522d086-17fb-4c06-9110-37ebc94b9bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.680885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522d086-17fb-4c06-9110-37ebc94b9bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.700741 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-7522d086-17fb-4c06-9110-37ebc94b9bd5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:06.702553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-7522d086-17fb-4c06-9110-37ebc94b9bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:06.705239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9749b-b505-414d-9653-a2c264fbe297 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.752521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de589ca0-92c9-4b23-8ff1-bd0755a341bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.753550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de589ca0-92c9-4b23-8ff1-bd0755a341bc None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.753894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de589ca0-92c9-4b23-8ff1-bd0755a341bc None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.754485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de589ca0-92c9-4b23-8ff1-bd0755a341bc None admin] PATH_INFO: `/v3/users/2c34c92d269c45ef972a345c88e142e7` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.757074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de589ca0-92c9-4b23-8ff1-bd0755a341bc None admin] RBAC: Authorizing `identity:get_user(user_id=2c34c92d269c45ef972a345c88e142e7)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:06.758978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de589ca0-92c9-4b23-8ff1-bd0755a341bc None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:06.762388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 156/310] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:06 2022] GET /identity/v3/users/2c34c92d269c45ef972a345c88e142e7 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:06.767511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de589ca0-92c9-4b23-8ff1-bd0755a341bc None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.816452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 155/311] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:06.845884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522d086-17fb-4c06-9110-37ebc94b9bd5 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:06.902412 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de589ca0-92c9-4b23-8ff1-bd0755a341bc None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:06.904323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:06.939323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:06.948954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a3d95-1c34-4145-9c47-15a0cff26f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:06.949890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a3d95-1c34-4145-9c47-15a0cff26f81 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:06.950644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a3d95-1c34-4145-9c47-15a0cff26f81 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:06.950979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a3d95-1c34-4145-9c47-15a0cff26f81 None admin] PATH_INFO: `/v3/system/users/2c34c92d269c45ef972a345c88e142e7/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:06.952788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a3d95-1c34-4145-9c47-15a0cff26f81 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2c34c92d269c45ef972a345c88e142e7, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:06.954301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a3d95-1c34-4145-9c47-15a0cff26f81 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:06.964224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 157/312] 10.222.0.13 () {58 vars in 1334 bytes} [Wed May 25 13:36:06 2022] PUT /identity/v3/system/users/2c34c92d269c45ef972a345c88e142e7/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:06.987211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522d086-17fb-4c06-9110-37ebc94b9bd5 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:07.030497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b2a6-2ed1-4940-9ee5-012b49dcc63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:07.031781 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b2a6-2ed1-4940-9ee5-012b49dcc63b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:07.032273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b2a6-2ed1-4940-9ee5-012b49dcc63b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:07.032755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b2a6-2ed1-4940-9ee5-012b49dcc63b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:07.046620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958b2a6-2ed1-4940-9ee5-012b49dcc63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-e958b2a6-2ed1-4940-9ee5-012b49dcc63b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:07.055224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:07.056238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:07.057078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:07.060711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 156/313] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:07.067170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a3d95-1c34-4145-9c47-15a0cff26f81 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:07.180818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a3d95-1c34-4145-9c47-15a0cff26f81 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:07.217992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:07.218618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:07.218907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:07.219187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:07.219944 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:07.220254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:07.221648 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:07.231578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 158/314] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:07.237010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b2a6-2ed1-4940-9ee5-012b49dcc63b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:07.346589 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b2a6-2ed1-4940-9ee5-012b49dcc63b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:07.348178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:07.383036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d685680-b329-4ee3-b8d0-01dd55a6bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:07.383910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685680-b329-4ee3-b8d0-01dd55a6bdda None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:07.384245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685680-b329-4ee3-b8d0-01dd55a6bdda None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:07.384527 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685680-b329-4ee3-b8d0-01dd55a6bdda None admin] PATH_INFO: `/v3/users/288955562be44df8b10c75f6b856b872` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:07.385762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d685680-b329-4ee3-b8d0-01dd55a6bdda None admin] RBAC: Authorizing `identity:get_user(user_id=288955562be44df8b10c75f6b856b872)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:07.387297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d685680-b329-4ee3-b8d0-01dd55a6bdda None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:07.389384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 157/315] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:07 2022] GET /identity/v3/users/288955562be44df8b10c75f6b856b872 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:07.394796 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:07.456774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:07.502141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde38bb-6e26-4300-9b44-e9f8982456fb None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:07.537715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8c11-8da6-49b6-8f3c-45483a301b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:07.538452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8c11-8da6-49b6-8f3c-45483a301b10 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:07.538746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8c11-8da6-49b6-8f3c-45483a301b10 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:07.539036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8c11-8da6-49b6-8f3c-45483a301b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:07.610926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c8c11-8da6-49b6-8f3c-45483a301b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:07.612409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c8c11-8da6-49b6-8f3c-45483a301b10 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:07.671019 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:07.715925 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 159/316] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:07.721768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d685680-b329-4ee3-b8d0-01dd55a6bdda None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:07.827952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d685680-b329-4ee3-b8d0-01dd55a6bdda None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:07.864360 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aadc5-7936-45fd-b1b7-487c96baa562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:07.865275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aadc5-7936-45fd-b1b7-487c96baa562 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:07.865608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aadc5-7936-45fd-b1b7-487c96baa562 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:07.865917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aadc5-7936-45fd-b1b7-487c96baa562 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:07.867124 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aadc5-7936-45fd-b1b7-487c96baa562 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:07.868653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aadc5-7936-45fd-b1b7-487c96baa562 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:07.870743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 158/317] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:07 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:07.876454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8c11-8da6-49b6-8f3c-45483a301b10 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:07.979287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8c11-8da6-49b6-8f3c-45483a301b10 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:08.019680 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f314b-a324-46de-8c1e-20ab96c8c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:08.020696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f314b-a324-46de-8c1e-20ab96c8c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:08.021186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f314b-a324-46de-8c1e-20ab96c8c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:08.021665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f314b-a324-46de-8c1e-20ab96c8c8a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:08.022742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f314b-a324-46de-8c1e-20ab96c8c8a5 None admin] RBAC: Adding query filter params (role.id=acb61715c6f849fca1c8d329abea7b1d, scope.project.id=0388b88e9f734e8a8e7feadddec96738, user.id=288955562be44df8b10c75f6b856b872) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:08.023262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f314b-a324-46de-8c1e-20ab96c8c8a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:08.024919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f314b-a324-46de-8c1e-20ab96c8c8a5 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:08.031655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 160/318] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:07 2022] GET /identity/v3/role_assignments?user.id=288955562be44df8b10c75f6b856b872&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=acb61715c6f849fca1c8d329abea7b1d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:09.139003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3673cd-2cbc-4704-a1ca-b1be14a36ea6 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.139516 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3673cd-2cbc-4704-a1ca-b1be14a36ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.139516 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3673cd-2cbc-4704-a1ca-b1be14a36ea6 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.141051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 159/319] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:09.146851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dfefe-55cf-4fa3-b593-20e80b0666d8 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.147347 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dfefe-55cf-4fa3-b593-20e80b0666d8 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.147422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dfefe-55cf-4fa3-b593-20e80b0666d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.164733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-4c9dfefe-55cf-4fa3-b593-20e80b0666d8 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:09.165964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-4c9dfefe-55cf-4fa3-b593-20e80b0666d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:09.185208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c288c-8a3f-402c-9b51-3d98366f729d None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.185493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c288c-8a3f-402c-9b51-3d98366f729d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.186043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c288c-8a3f-402c-9b51-3d98366f729d None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.186157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:09.187852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 160/320] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:36:09.194402 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0ff3-13f1-4d26-86f7-b8e6cd581d39 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.194927 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0ff3-13f1-4d26-86f7-b8e6cd581d39 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.195230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0ff3-13f1-4d26-86f7-b8e6cd581d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.213780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-075b0ff3-13f1-4d26-86f7-b8e6cd581d39 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:09.215821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-075b0ff3-13f1-4d26-86f7-b8e6cd581d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:09.243376 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 161/321] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:09.247279 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:09.265874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dfefe-55cf-4fa3-b593-20e80b0666d8 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.289119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 161/322] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:09.311537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0ff3-13f1-4d26-86f7-b8e6cd581d39 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.367332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dfefe-55cf-4fa3-b593-20e80b0666d8 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:09.409113 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1e72b-f4a8-4b77-ab75-96c3b4696169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:09.409851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e72b-f4a8-4b77-ab75-96c3b4696169 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.410132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e72b-f4a8-4b77-ab75-96c3b4696169 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.410403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e72b-f4a8-4b77-ab75-96c3b4696169 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.413969 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0ff3-13f1-4d26-86f7-b8e6cd581d39 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:09.420978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1e72b-f4a8-4b77-ab75-96c3b4696169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-deb1e72b-f4a8-4b77-ab75-96c3b4696169 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:09.428619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:09.429709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:09.430681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 162/323] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:09.431422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313db45-74da-4991-892d-37b0c1346b7c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.431422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313db45-74da-4991-892d-37b0c1346b7c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.431614 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313db45-74da-4991-892d-37b0c1346b7c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.433497 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 163/324] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:09.438077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313db45-74da-4991-892d-37b0c1346b7c None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.451810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e582ad-5f89-4bf3-bb7f-fa99be8366b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:09.452600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e582ad-5f89-4bf3-bb7f-fa99be8366b3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.452883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e582ad-5f89-4bf3-bb7f-fa99be8366b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.453160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e582ad-5f89-4bf3-bb7f-fa99be8366b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.453696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:09.454350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e582ad-5f89-4bf3-bb7f-fa99be8366b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:09.455864 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e582ad-5f89-4bf3-bb7f-fa99be8366b3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:09.462699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 162/325] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:09.462699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195aae4-e03a-44c4-8e23-1841655e024d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.462699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195aae4-e03a-44c4-8e23-1841655e024d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.462699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195aae4-e03a-44c4-8e23-1841655e024d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.476502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-2195aae4-e03a-44c4-8e23-1841655e024d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:09.477717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-2195aae4-e03a-44c4-8e23-1841655e024d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:09.507870 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:09.540511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313db45-74da-4991-892d-37b0c1346b7c None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:09.544954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 163/326] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:09.545885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195aae4-e03a-44c4-8e23-1841655e024d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.578828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:09.579500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.579785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.580066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.580812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:09.581128 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:09.582540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:09.595429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 164/327] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:09.595429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.643345 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195aae4-e03a-44c4-8e23-1841655e024d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:09.668261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:09.677403 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5ac98-829b-4098-a561-3d44d9fae888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:09.678129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ac98-829b-4098-a561-3d44d9fae888 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.678414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ac98-829b-4098-a561-3d44d9fae888 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.678691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ac98-829b-4098-a561-3d44d9fae888 None admin] PATH_INFO: `/v3/groups` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.679393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5ac98-829b-4098-a561-3d44d9fae888 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:09.680890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5ac98-829b-4098-a561-3d44d9fae888 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:09.695302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f365c5c-55b3-403d-a4a9-d884013d8166 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:09.695918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 164/328] 10.222.0.13 () {60 vars in 1134 bytes} [Wed May 25 13:36:09 2022] POST /identity/v3/groups => generated 226 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:36:09.696871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5ac98-829b-4098-a561-3d44d9fae888 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.729175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:09.737303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb620d36-eab3-4184-b5b0-dd707c8e48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:09.738482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620d36-eab3-4184-b5b0-dd707c8e48c5 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.738911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620d36-eab3-4184-b5b0-dd707c8e48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.739330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620d36-eab3-4184-b5b0-dd707c8e48c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.752393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb620d36-eab3-4184-b5b0-dd707c8e48c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-cb620d36-eab3-4184-b5b0-dd707c8e48c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:09.760506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:09.762980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:09.763797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 165/329] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:09.768658 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb620d36-eab3-4184-b5b0-dd707c8e48c5 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.824846 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5ac98-829b-4098-a561-3d44d9fae888 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:09.865614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b5e44-762c-4f3a-bc3a-8612c73563c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:09.866696 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b5e44-762c-4f3a-bc3a-8612c73563c0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.867110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b5e44-762c-4f3a-bc3a-8612c73563c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.867471 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b5e44-762c-4f3a-bc3a-8612c73563c0 None admin] PATH_INFO: `/v3/users/afd00513c7404cc3a8aca9a424ed099f` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.868767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b5e44-762c-4f3a-bc3a-8612c73563c0 None admin] RBAC: Authorizing `identity:get_user(user_id=afd00513c7404cc3a8aca9a424ed099f)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:09.870921 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b5e44-762c-4f3a-bc3a-8612c73563c0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:09.872834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 165/330] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:09 2022] GET /identity/v3/users/afd00513c7404cc3a8aca9a424ed099f => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:09.878879 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b5e44-762c-4f3a-bc3a-8612c73563c0 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.887999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb620d36-eab3-4184-b5b0-dd707c8e48c5 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:09.933848 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:09.934913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:09.935214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:09.938136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:09.938136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:09.938136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:09.938136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:09.939664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:09.949333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 166/331] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:09.954716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:09.993493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:09.998075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b5e44-762c-4f3a-bc3a-8612c73563c0 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:10.049699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20c1ac-6bb5-4563-b8c6-6cbbeb40dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:10.050603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20c1ac-6bb5-4563-b8c6-6cbbeb40dac1 None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:10.050891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20c1ac-6bb5-4563-b8c6-6cbbeb40dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:10.051175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20c1ac-6bb5-4563-b8c6-6cbbeb40dac1 None admin] PATH_INFO: `/v3/system/users/afd00513c7404cc3a8aca9a424ed099f/roles/acb61715c6f849fca1c8d329abea7b1d` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:10.052813 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20c1ac-6bb5-4563-b8c6-6cbbeb40dac1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=afd00513c7404cc3a8aca9a424ed099f, role_id=acb61715c6f849fca1c8d329abea7b1d)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:10.054258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20c1ac-6bb5-4563-b8c6-6cbbeb40dac1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:10.066598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 166/332] 10.222.0.13 () {58 vars in 1334 bytes} [Wed May 25 13:36:09 2022] PUT /identity/v3/system/users/afd00513c7404cc3a8aca9a424ed099f/roles/acb61715c6f849fca1c8d329abea7b1d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:10.081758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0e12a-a746-4f7f-bae0-148a4e6a8df2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:10.123400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9d71f-bee8-4ee3-9258-65d5cd5ea3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:10.124292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d71f-bee8-4ee3-9258-65d5cd5ea3be None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:10.124572 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d71f-bee8-4ee3-9258-65d5cd5ea3be None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:10.124843 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9d71f-bee8-4ee3-9258-65d5cd5ea3be None admin] PATH_INFO: `/v3/users/2c34c92d269c45ef972a345c88e142e7` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:10.126105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9d71f-bee8-4ee3-9258-65d5cd5ea3be None admin] RBAC: Authorizing `identity:get_user(user_id=2c34c92d269c45ef972a345c88e142e7)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:10.127593 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9d71f-bee8-4ee3-9258-65d5cd5ea3be None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:10.129640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 167/333] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:09 2022] GET /identity/v3/users/2c34c92d269c45ef972a345c88e142e7 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:10.135351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20c1ac-6bb5-4563-b8c6-6cbbeb40dac1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:10.253883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20c1ac-6bb5-4563-b8c6-6cbbeb40dac1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:10.291907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2db06-4e07-420f-ac4c-50a5626ce55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:10.293463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2db06-4e07-420f-ac4c-50a5626ce55d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:10.294003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2db06-4e07-420f-ac4c-50a5626ce55d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:10.294506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2db06-4e07-420f-ac4c-50a5626ce55d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:10.295551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2db06-4e07-420f-ac4c-50a5626ce55d None admin] RBAC: Adding query filter params (role.id=6076bee6c25b4df5bfbd3f00b06c314b, user.id=2c34c92d269c45ef972a345c88e142e7, scope.system=all) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:10.296069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2db06-4e07-420f-ac4c-50a5626ce55d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:10.297763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2db06-4e07-420f-ac4c-50a5626ce55d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:10.310922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 167/334] 10.222.0.13 () {56 vars in 1308 bytes} [Wed May 25 13:36:10 2022] GET /identity/v3/role_assignments?user.id=2c34c92d269c45ef972a345c88e142e7&scope.system=all&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:12.161420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331c23-cb41-4c7f-8086-3b98e3df6df9 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:12.161964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331c23-cb41-4c7f-8086-3b98e3df6df9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:12.161964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331c23-cb41-4c7f-8086-3b98e3df6df9 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:12.163615 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 168/335] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:12.169091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213368-ff68-4b17-9e5c-51231dcc47be None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:12.170007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213368-ff68-4b17-9e5c-51231dcc47be None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:12.170500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213368-ff68-4b17-9e5c-51231dcc47be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:12.192533 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-23213368-ff68-4b17-9e5c-51231dcc47be None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:12.194115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-23213368-ff68-4b17-9e5c-51231dcc47be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:12.210153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:12.284647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 168/336] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:12.320926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31331c23-cb41-4c7f-8086-3b98e3df6df9 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:12.410133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:12.455732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31331c23-cb41-4c7f-8086-3b98e3df6df9 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:12.501514 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5810fd-b201-42b8-a0a6-eb5c18f8c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:12.502883 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5810fd-b201-42b8-a0a6-eb5c18f8c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:12.503473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5810fd-b201-42b8-a0a6-eb5c18f8c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:12.503884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5810fd-b201-42b8-a0a6-eb5c18f8c1e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:12.522527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5810fd-b201-42b8-a0a6-eb5c18f8c1e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-fa5810fd-b201-42b8-a0a6-eb5c18f8c1e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:12.540913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:12.542003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:12.543055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 169/337] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:12.551448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23213368-ff68-4b17-9e5c-51231dcc47be None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:12.698181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23213368-ff68-4b17-9e5c-51231dcc47be None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:12.713981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027cdf3-3e8f-4a2e-87e7-a1da9532014b None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:12.714286 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027cdf3-3e8f-4a2e-87e7-a1da9532014b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:12.714482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027cdf3-3e8f-4a2e-87e7-a1da9532014b None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:12.716738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 170/338] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:12.724847 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3a4d-6c4e-41aa-b3fd-9e78ab263fea None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:12.725408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3a4d-6c4e-41aa-b3fd-9e78ab263fea None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:12.725696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3a4d-6c4e-41aa-b3fd-9e78ab263fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:12.754078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b8bb3a4d-6c4e-41aa-b3fd-9e78ab263fea None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:12.755294 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b8bb3a4d-6c4e-41aa-b3fd-9e78ab263fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:12.760651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:12.762024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:12.762315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:12.762593 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:12.763362 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:12.763671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:12.765063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:12.795177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 169/339] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:12.796152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:12.813701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:12.920564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 171/340] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:12.973239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af90f9-7795-40e1-80d2-18a95b8fccf2 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:13.017935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e423-e90c-4f8b-a30b-319275feb27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:13.018592 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e423-e90c-4f8b-a30b-319275feb27c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.018881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e423-e90c-4f8b-a30b-319275feb27c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.019143 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e423-e90c-4f8b-a30b-319275feb27c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.047548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb3a4d-6c4e-41aa-b3fd-9e78ab263fea None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:13.108294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75e423-e90c-4f8b-a30b-319275feb27c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:13.109837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75e423-e90c-4f8b-a30b-319275feb27c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:13.124434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:13.213187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:13.221837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 170/341] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:13.223577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1bbed-5085-4245-80a0-1f4b38c18a67 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.223926 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1bbed-5085-4245-80a0-1f4b38c18a67 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.224419 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1bbed-5085-4245-80a0-1f4b38c18a67 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.225902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 171/342] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:13.233256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1bbed-5085-4245-80a0-1f4b38c18a67 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:13.356054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1bbed-5085-4245-80a0-1f4b38c18a67 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:13.370112 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:13.388097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb3a4d-6c4e-41aa-b3fd-9e78ab263fea None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:13.396425 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e2945-403b-4f14-bc40-4eb09d9c8f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:13.397433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2945-403b-4f14-bc40-4eb09d9c8f3a None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.397867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2945-403b-4f14-bc40-4eb09d9c8f3a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.398256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2945-403b-4f14-bc40-4eb09d9c8f3a None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.400322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e2945-403b-4f14-bc40-4eb09d9c8f3a None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:13.402643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e2945-403b-4f14-bc40-4eb09d9c8f3a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:13.405378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 172/343] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:13 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:13.407202 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f356-511d-4de3-bba2-162483632612 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.407604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f356-511d-4de3-bba2-162483632612 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.407993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f356-511d-4de3-bba2-162483632612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.427687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-3830f356-511d-4de3-bba2-162483632612 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:13.429306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-3830f356-511d-4de3-bba2-162483632612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:13.497876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c4bd7-ea8f-473c-8c7b-0f145df9f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:13.498612 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4bd7-ea8f-473c-8c7b-0f145df9f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.498899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4bd7-ea8f-473c-8c7b-0f145df9f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.499177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4bd7-ea8f-473c-8c7b-0f145df9f5d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.505073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 173/344] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:13.506299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830f356-511d-4de3-bba2-162483632612 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:13.530366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c4bd7-ea8f-473c-8c7b-0f145df9f5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-d24c4bd7-ea8f-473c-8c7b-0f145df9f5d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:13.538773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:13.539676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:13.540529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 172/345] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:36:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 494 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:13.541232 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e50460-3a45-41db-a6ee-c4703ef7db9c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.541709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e50460-3a45-41db-a6ee-c4703ef7db9c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.546953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e50460-3a45-41db-a6ee-c4703ef7db9c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.548389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 173/346] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:13.552962 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e50460-3a45-41db-a6ee-c4703ef7db9c None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:13.625189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830f356-511d-4de3-bba2-162483632612 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:13.650232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:13.675222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a862034-eb58-4c4d-a1fe-7b5eb33126e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:13.676590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a862034-eb58-4c4d-a1fe-7b5eb33126e3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.677331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a862034-eb58-4c4d-a1fe-7b5eb33126e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.677628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a862034-eb58-4c4d-a1fe-7b5eb33126e3 None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.686174 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a862034-eb58-4c4d-a1fe-7b5eb33126e3 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:13.688152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a862034-eb58-4c4d-a1fe-7b5eb33126e3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:13.690589 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 174/347] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:13 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:13.692446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c358e-0c66-46ea-9545-073b932eaa51 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.692746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c358e-0c66-46ea-9545-073b932eaa51 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.693189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c358e-0c66-46ea-9545-073b932eaa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.697615 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e50460-3a45-41db-a6ee-c4703ef7db9c None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:13.717815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9b3c358e-0c66-46ea-9545-073b932eaa51 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:13.719586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9b3c358e-0c66-46ea-9545-073b932eaa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:13.722802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:13.739639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:13.740329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.740626 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.740914 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.741677 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:13.743455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:13.745787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:13.753868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 174/348] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:13.758465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:13.817024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 175/349] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:13.821942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c358e-0c66-46ea-9545-073b932eaa51 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:13.906430 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c44e1-e9c4-4091-b332-b16d43bfe31e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:13.942899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25853d2e-dd48-47eb-b6fe-95c4beccccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:13.943721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853d2e-dd48-47eb-b6fe-95c4beccccd0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:13.944010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853d2e-dd48-47eb-b6fe-95c4beccccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:13.944289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853d2e-dd48-47eb-b6fe-95c4beccccd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:13.955863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25853d2e-dd48-47eb-b6fe-95c4beccccd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-25853d2e-dd48-47eb-b6fe-95c4beccccd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:13.964770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:13.965801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:13.966704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 175/350] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:13.972011 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25853d2e-dd48-47eb-b6fe-95c4beccccd0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:13.973349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:13.977056 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c358e-0c66-46ea-9545-073b932eaa51 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:14.013389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:14.015207 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:14.016052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:14.016499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:14.016955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:14.017985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] RBAC: Adding query filter params (group.id=2c2adb1b01134a6587b3912727440804, role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=37e3413dfe4e45d486e2cfee347f9856) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:14.018524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:14.020005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:14.026077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 176/351] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:13 2022] GET /identity/v3/role_assignments?group.id=2c2adb1b01134a6587b3912727440804&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:14.026923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:14.117307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25853d2e-dd48-47eb-b6fe-95c4beccccd0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:14.162483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e270-d0fe-4b45-a587-aaaa75bfbc1d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:14.192665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a9021-2b3b-40d2-9e14-c92895b5920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:14.193349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9021-2b3b-40d2-9e14-c92895b5920f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:14.193642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9021-2b3b-40d2-9e14-c92895b5920f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:14.193952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9021-2b3b-40d2-9e14-c92895b5920f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:14.230913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43d4d-45d8-4b3b-9898-ff274b838794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:14.231728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43d4d-45d8-4b3b-9898-ff274b838794 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:14.232019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43d4d-45d8-4b3b-9898-ff274b838794 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:14.232304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43d4d-45d8-4b3b-9898-ff274b838794 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:14.255699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb43d4d-45d8-4b3b-9898-ff274b838794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-1cb43d4d-45d8-4b3b-9898-ff274b838794 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:14.265759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:14.266900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:14.267788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:14.268656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 177/352] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:14.269514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43d4d-45d8-4b3b-9898-ff274b838794 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:14.308948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a9021-2b3b-40d2-9e14-c92895b5920f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:14.312209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a9021-2b3b-40d2-9e14-c92895b5920f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:14.328068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:14.405628 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:14.434075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43d4d-45d8-4b3b-9898-ff274b838794 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:14.504755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:14.505448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:14.505801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:14.506055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:14.506839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:14.507149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:14.508571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:14.511975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 176/353] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:14.513036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a9021-2b3b-40d2-9e14-c92895b5920f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:14.530155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 178/354] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:14.531025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:14.627518 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a9021-2b3b-40d2-9e14-c92895b5920f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:14.665718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:14.666656 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:14.667158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:14.668090 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:14.669004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:14.669463 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:14.671046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:14.673565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:14.677383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:14.680740 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 177/355] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:14.681595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:14.702806 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01641927-4178-4e04-b2fb-74ee8724bfd7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:14.778480 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c242502-c370-413e-a109-fe255ddb4f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:14.779367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c242502-c370-413e-a109-fe255ddb4f20 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:14.779668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c242502-c370-413e-a109-fe255ddb4f20 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:14.779954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c242502-c370-413e-a109-fe255ddb4f20 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:14.789084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c242502-c370-413e-a109-fe255ddb4f20 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:14.789084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c242502-c370-413e-a109-fe255ddb4f20 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:14.793013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 179/356] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:14 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:14.793159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbc06f-62a8-4d12-82ec-f9dc59bab211 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:14.793252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c242502-c370-413e-a109-fe255ddb4f20 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:14.832572 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d2502-d4ab-400d-9675-e4045f42aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:14.833548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2502-d4ab-400d-9675-e4045f42aebd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:14.833921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2502-d4ab-400d-9675-e4045f42aebd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:14.834218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2502-d4ab-400d-9675-e4045f42aebd None admin] PATH_INFO: `/v3/users/afd00513c7404cc3a8aca9a424ed099f` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:14.835907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d2502-d4ab-400d-9675-e4045f42aebd None admin] RBAC: Authorizing `identity:get_user(user_id=afd00513c7404cc3a8aca9a424ed099f)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:14.837511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d2502-d4ab-400d-9675-e4045f42aebd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:14.840165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 178/357] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:36:14 2022] GET /identity/v3/users/afd00513c7404cc3a8aca9a424ed099f => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:14.840838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d2502-d4ab-400d-9675-e4045f42aebd None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:14.921570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:14.978277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d2502-d4ab-400d-9675-e4045f42aebd None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:15.005429 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c242502-c370-413e-a109-fe255ddb4f20 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:15.049001 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344b3a1-44f2-4d82-a12f-cbc9b7f0292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:15.049834 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344b3a1-44f2-4d82-a12f-cbc9b7f0292e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.050393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344b3a1-44f2-4d82-a12f-cbc9b7f0292e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.050682 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344b3a1-44f2-4d82-a12f-cbc9b7f0292e None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.053303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344b3a1-44f2-4d82-a12f-cbc9b7f0292e None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:15.055273 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344b3a1-44f2-4d82-a12f-cbc9b7f0292e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:15.057452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 179/358] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:14 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:15.058403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344b3a1-44f2-4d82-a12f-cbc9b7f0292e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:15.082771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe5591-d406-4bf4-8abf-454ec810c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:15.083441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe5591-d406-4bf4-8abf-454ec810c553 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.083735 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe5591-d406-4bf4-8abf-454ec810c553 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.084016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe5591-d406-4bf4-8abf-454ec810c553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.119799 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:15.170055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe5591-d406-4bf4-8abf-454ec810c553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:15.171900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe5591-d406-4bf4-8abf-454ec810c553 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:15.177924 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344b3a1-44f2-4d82-a12f-cbc9b7f0292e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:15.218297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cababb71-a054-4c5f-9cb9-7a21e1c68176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:15.218967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cababb71-a054-4c5f-9cb9-7a21e1c68176 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.219260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cababb71-a054-4c5f-9cb9-7a21e1c68176 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.219544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cababb71-a054-4c5f-9cb9-7a21e1c68176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.220379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cababb71-a054-4c5f-9cb9-7a21e1c68176 None admin] RBAC: Adding query filter params (role.id=acb61715c6f849fca1c8d329abea7b1d, user.id=afd00513c7404cc3a8aca9a424ed099f, scope.system=all) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:15.220693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cababb71-a054-4c5f-9cb9-7a21e1c68176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:15.223164 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cababb71-a054-4c5f-9cb9-7a21e1c68176 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:15.225142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:15.239385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 180/359] 10.222.0.13 () {56 vars in 1308 bytes} [Wed May 25 13:36:15 2022] GET /identity/v3/role_assignments?user.id=afd00513c7404cc3a8aca9a424ed099f&scope.system=all&role.id=acb61715c6f849fca1c8d329abea7b1d => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:15.240737 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c955aa0-b737-4645-baee-f0973b179088 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.241034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c955aa0-b737-4645-baee-f0973b179088 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.241321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c955aa0-b737-4645-baee-f0973b179088 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.247300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 181/360] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:15.247300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c955aa0-b737-4645-baee-f0973b179088 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:15.312039 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 180/361] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:15.314307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c156d-feca-4454-8d4f-661e0fd60cd9 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.314876 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c156d-feca-4454-8d4f-661e0fd60cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.315383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c156d-feca-4454-8d4f-661e0fd60cd9 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.317268 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 181/362] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:15.323166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493045-b3db-4230-aab5-e53008276e25 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.324357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493045-b3db-4230-aab5-e53008276e25 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.324935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493045-b3db-4230-aab5-e53008276e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.349205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9c493045-b3db-4230-aab5-e53008276e25 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:15.350486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9c493045-b3db-4230-aab5-e53008276e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:15.384218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c955aa0-b737-4645-baee-f0973b179088 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:15.438501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:15.439010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:15.439753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.440063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.440347 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.441348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] RBAC: Adding query filter params (group.id=2c2adb1b01134a6587b3912727440804, role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=37e3413dfe4e45d486e2cfee347f9856) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:15.441669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:15.443214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:15.455520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 182/363] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:15 2022] GET /identity/v3/role_assignments?group.id=2c2adb1b01134a6587b3912727440804&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:15.456393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:15.459512 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 182/364] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:15.461050 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e2ddf-8498-4303-a44e-9f248ddd0b8d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.461247 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e2ddf-8498-4303-a44e-9f248ddd0b8d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.461530 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e2ddf-8498-4303-a44e-9f248ddd0b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.482374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-6d9e2ddf-8498-4303-a44e-9f248ddd0b8d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:15.483633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-6d9e2ddf-8498-4303-a44e-9f248ddd0b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:15.528346 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:15.575298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 183/365] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:15.575947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e2ddf-8498-4303-a44e-9f248ddd0b8d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:15.591255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977bd08-abda-4da9-85dc-9b392d140a7b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:15.652004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae403-755e-4d37-947f-60ebc8e7e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:15.653496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae403-755e-4d37-947f-60ebc8e7e442 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.653826 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae403-755e-4d37-947f-60ebc8e7e442 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.654115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae403-755e-4d37-947f-60ebc8e7e442 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.656333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae403-755e-4d37-947f-60ebc8e7e442 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:15.658108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae403-755e-4d37-947f-60ebc8e7e442 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:15.662987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 183/366] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:15 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:15.662987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae403-755e-4d37-947f-60ebc8e7e442 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:15.727546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e2ddf-8498-4303-a44e-9f248ddd0b8d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:15.754147 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:15.777714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3207d-cd64-40d4-bd07-570ec5e7fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:15.779422 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3207d-cd64-40d4-bd07-570ec5e7fa3f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.779957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3207d-cd64-40d4-bd07-570ec5e7fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.780244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3207d-cd64-40d4-bd07-570ec5e7fa3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.796707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3207d-cd64-40d4-bd07-570ec5e7fa3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-ffc3207d-cd64-40d4-bd07-570ec5e7fa3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:15.806099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:15.808490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 184/367] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:36:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:15.809511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3207d-cd64-40d4-bd07-570ec5e7fa3f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:15.835686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae403-755e-4d37-947f-60ebc8e7e442 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:15.863897 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:15.876306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995c6d-711c-4119-a0ad-af06763ed2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:15.877463 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995c6d-711c-4119-a0ad-af06763ed2e6 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.878008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995c6d-711c-4119-a0ad-af06763ed2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.878512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995c6d-711c-4119-a0ad-af06763ed2e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.891514 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66995c6d-711c-4119-a0ad-af06763ed2e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-66995c6d-711c-4119-a0ad-af06763ed2e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:15.908434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:15.909397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:15.910267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:15.912750 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 184/368] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:36:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:15.913884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995c6d-711c-4119-a0ad-af06763ed2e6 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:15.942028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3207d-cd64-40d4-bd07-570ec5e7fa3f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:15.989760 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d598c-ce5b-4396-927f-c876d70b9a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:15.990790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d598c-ce5b-4396-927f-c876d70b9a8f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:15.991083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d598c-ce5b-4396-927f-c876d70b9a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:15.991367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d598c-ce5b-4396-927f-c876d70b9a8f None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:15.992820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d598c-ce5b-4396-927f-c876d70b9a8f None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:15.994729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d598c-ce5b-4396-927f-c876d70b9a8f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:15.997304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 185/369] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:15 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:15.998784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d598c-ce5b-4396-927f-c876d70b9a8f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:16.042678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995c6d-711c-4119-a0ad-af06763ed2e6 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:16.061101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:16.094081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:16.095389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.095901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.096407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:16.097635 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:16.098787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:16.100734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:16.113141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 185/370] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:16.114832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:16.151178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d598c-ce5b-4396-927f-c876d70b9a8f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:16.179614 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:16.191526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:16.192469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.192902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.193366 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:16.194527 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:16.195018 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:16.196648 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:16.207201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 186/371] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:16.209203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:16.254884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f1e76-b016-4400-a647-768818cdf134 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:16.302720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:16.303404 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.304223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.304523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:16.305673 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] RBAC: Adding query filter params (group.id=2c2adb1b01134a6587b3912727440804, role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=0388b88e9f734e8a8e7feadddec96738) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:16.306032 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:16.307817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:16.321557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 186/372] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:16 2022] GET /identity/v3/role_assignments?group.id=2c2adb1b01134a6587b3912727440804&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:16.321557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:16.361429 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceb7a0-cdab-4fe8-b49d-1907e75a4b25 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:16.372343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:16.448703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5220-83d3-4353-a895-676407b76302 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:16.459843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62ffc-40bc-499a-aff0-7390bd6e9a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:16.461111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62ffc-40bc-499a-aff0-7390bd6e9a3f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.461619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62ffc-40bc-499a-aff0-7390bd6e9a3f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.461966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:16.462789 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62ffc-40bc-499a-aff0-7390bd6e9a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:16.495189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897719-df97-4e5e-9648-ea58feebbc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:16.495887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897719-df97-4e5e-9648-ea58feebbc08 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.496391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897719-df97-4e5e-9648-ea58feebbc08 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.496816 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897719-df97-4e5e-9648-ea58feebbc08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:16.559194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda62ffc-40bc-499a-aff0-7390bd6e9a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:16.561233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda62ffc-40bc-499a-aff0-7390bd6e9a3f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:16.595103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897719-df97-4e5e-9648-ea58feebbc08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:16.597613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897719-df97-4e5e-9648-ea58feebbc08 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:16.702660 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 187/373] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:16.711276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62ffc-40bc-499a-aff0-7390bd6e9a3f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:16.717458 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:16.759134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 187/374] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:16.765145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897719-df97-4e5e-9648-ea58feebbc08 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:16.784901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:16.860589 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62ffc-40bc-499a-aff0-7390bd6e9a3f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:16.918549 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897719-df97-4e5e-9648-ea58feebbc08 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:16.931611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24b05-414e-4b92-8933-f8b0163dae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:16.932511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24b05-414e-4b92-8933-f8b0163dae23 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.933349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24b05-414e-4b92-8933-f8b0163dae23 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.933633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24b05-414e-4b92-8933-f8b0163dae23 None admin] PATH_INFO: `/v3/projects/48375e55fddc4df099c1a83243da1d15` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:16.935121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24b05-414e-4b92-8933-f8b0163dae23 None admin] RBAC: Authorizing `identity:get_project(project_id=48375e55fddc4df099c1a83243da1d15)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:16.936629 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24b05-414e-4b92-8933-f8b0163dae23 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:16.938927 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 188/375] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:16 2022] GET /identity/v3/projects/48375e55fddc4df099c1a83243da1d15 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:16.940315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed23c4d-0dc2-4113-be39-cd5a9a3f19bd None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.940608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed23c4d-0dc2-4113-be39-cd5a9a3f19bd None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.940889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed23c4d-0dc2-4113-be39-cd5a9a3f19bd None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:16.942585 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 189/376] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:16.947810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed23c4d-0dc2-4113-be39-cd5a9a3f19bd None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:16.975106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d18b09-dc14-424f-99ae-d1007dfb1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:16.976370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d18b09-dc14-424f-99ae-d1007dfb1b2b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.976663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d18b09-dc14-424f-99ae-d1007dfb1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.977210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d18b09-dc14-424f-99ae-d1007dfb1b2b None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:16.978629 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d18b09-dc14-424f-99ae-d1007dfb1b2b None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:16.980788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d18b09-dc14-424f-99ae-d1007dfb1b2b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:16.983711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 188/377] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:16 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:16.985071 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0518-c36e-4fef-8d99-2770687e2d34 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:16.985369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0518-c36e-4fef-8d99-2770687e2d34 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:16.985654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0518-c36e-4fef-8d99-2770687e2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:17.008034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-18ca0518-c36e-4fef-8d99-2770687e2d34 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:17.009580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-18ca0518-c36e-4fef-8d99-2770687e2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:17.038148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:17.077041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed23c4d-0dc2-4113-be39-cd5a9a3f19bd None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:17.090302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 189/378] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:17.091603 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0518-c36e-4fef-8d99-2770687e2d34 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:17.110540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:17.140122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b0298-c5b6-49cb-82a4-a5cd2144b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:17.141383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b0298-c5b6-49cb-82a4-a5cd2144b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:17.142051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b0298-c5b6-49cb-82a4-a5cd2144b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:17.142535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b0298-c5b6-49cb-82a4-a5cd2144b4f8 None admin] PATH_INFO: `/v3/groups/e11a33e2d5d545c9ac0a72fe8f67dbac` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:17.150304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b0298-c5b6-49cb-82a4-a5cd2144b4f8 None admin] RBAC: Authorizing `identity:get_group(group_id=e11a33e2d5d545c9ac0a72fe8f67dbac)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:17.152077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b0298-c5b6-49cb-82a4-a5cd2144b4f8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:17.154223 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 190/379] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:16 2022] GET /identity/v3/groups/e11a33e2d5d545c9ac0a72fe8f67dbac => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:17.155398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b0298-c5b6-49cb-82a4-a5cd2144b4f8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:17.232465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0518-c36e-4fef-8d99-2770687e2d34 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:17.278499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35b1ba-62cf-4837-b1b0-5f3fd5c74660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:17.279367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35b1ba-62cf-4837-b1b0-5f3fd5c74660 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:17.279653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35b1ba-62cf-4837-b1b0-5f3fd5c74660 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:17.279997 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35b1ba-62cf-4837-b1b0-5f3fd5c74660 None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:17.280794 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b0298-c5b6-49cb-82a4-a5cd2144b4f8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:17.281248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35b1ba-62cf-4837-b1b0-5f3fd5c74660 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:17.282762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35b1ba-62cf-4837-b1b0-5f3fd5c74660 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:17.284595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 190/380] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:17 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:17.285192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35b1ba-62cf-4837-b1b0-5f3fd5c74660 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:17.330702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b042-dbb1-432c-942a-1de48b987808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:17.331912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b042-dbb1-432c-942a-1de48b987808 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:17.332430 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b042-dbb1-432c-942a-1de48b987808 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:17.332940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b042-dbb1-432c-942a-1de48b987808 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:17.336901 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:17.347482 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6b042-dbb1-432c-942a-1de48b987808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4de6b042-dbb1-432c-942a-1de48b987808 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:17.356779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:17.357711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:17.358780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:17.361063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 191/381] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:17.362414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b042-dbb1-432c-942a-1de48b987808 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:17.390622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:17.424102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35b1ba-62cf-4837-b1b0-5f3fd5c74660 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:17.475989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:17.476766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:17.477016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:17.477302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:17.478181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] RBAC: Adding query filter params (group.id=e11a33e2d5d545c9ac0a72fe8f67dbac, role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=48375e55fddc4df099c1a83243da1d15) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:17.478510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:17.480608 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:17.492349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b042-dbb1-432c-942a-1de48b987808 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:17.499519 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 191/382] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:17 2022] GET /identity/v3/role_assignments?group.id=e11a33e2d5d545c9ac0a72fe8f67dbac&scope.project.id=48375e55fddc4df099c1a83243da1d15&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:17.500383 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:17.531510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:17.532205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:17.532503 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:17.532794 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:17.533657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] RBAC: Adding query filter params (group.id=2c2adb1b01134a6587b3912727440804, role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=0388b88e9f734e8a8e7feadddec96738) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:17.534030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:17.535855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:17.543570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 192/383] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:17 2022] GET /identity/v3/role_assignments?group.id=2c2adb1b01134a6587b3912727440804&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:17.680148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f45fb6-3b64-4d46-8a91-3ed6fe487289 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:17.733882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:17.734595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:17.734888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:17.735170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:17.735944 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:17.736257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:17.737680 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:17.750460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 192/384] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:17.756445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:17.869914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:17.914827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8b438-620c-4f5f-8ba4-cb6805764abc None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:17.958676 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06739131-45c4-433b-a623-8c1825b431e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:17.959591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06739131-45c4-433b-a623-8c1825b431e4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:17.959882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06739131-45c4-433b-a623-8c1825b431e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:17.960164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06739131-45c4-433b-a623-8c1825b431e4 None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:17.961937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06739131-45c4-433b-a623-8c1825b431e4 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:17.963656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06739131-45c4-433b-a623-8c1825b431e4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:17.966221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 193/385] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:17 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:17.972146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:17.980355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:18.124008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81348b-8a9f-40c2-b3da-fbe7f760d10b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:18.166742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a1132-5527-47ed-8120-1d9fb0107a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:18.167660 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1132-5527-47ed-8120-1d9fb0107a63 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:18.167953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1132-5527-47ed-8120-1d9fb0107a63 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:18.168238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1132-5527-47ed-8120-1d9fb0107a63 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:18.174513 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a1132-5527-47ed-8120-1d9fb0107a63 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:18.176030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a1132-5527-47ed-8120-1d9fb0107a63 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:18.178142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 193/386] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:17 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:18.184195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06739131-45c4-433b-a623-8c1825b431e4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:18.322262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06739131-45c4-433b-a623-8c1825b431e4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:18.361585 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:18.368874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ea44-1249-4326-8163-d6f074e21154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:18.369792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ea44-1249-4326-8163-d6f074e21154 None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:18.370214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ea44-1249-4326-8163-d6f074e21154 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:18.370585 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ea44-1249-4326-8163-d6f074e21154 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856/groups/2c2adb1b01134a6587b3912727440804/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:18.374596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89ea44-1249-4326-8163-d6f074e21154 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e3413dfe4e45d486e2cfee347f9856, group_id=2c2adb1b01134a6587b3912727440804, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:18.376026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89ea44-1249-4326-8163-d6f074e21154 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:18.382454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c8b4-9087-45e2-8818-770174d9db07 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:18.382752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c8b4-9087-45e2-8818-770174d9db07 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:18.383037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c8b4-9087-45e2-8818-770174d9db07 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:18.384704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 194/387] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:18.394530 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 194/388] 10.222.0.13 () {58 vars in 1442 bytes} [Wed May 25 13:36:18 2022] PUT /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856/groups/2c2adb1b01134a6587b3912727440804/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:18.395079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eccfde-93bd-48c8-98d1-809dbaf70ec4 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:18.395449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eccfde-93bd-48c8-98d1-809dbaf70ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:18.395741 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eccfde-93bd-48c8-98d1-809dbaf70ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:18.435248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-21eccfde-93bd-48c8-98d1-809dbaf70ec4 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:18.436507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-21eccfde-93bd-48c8-98d1-809dbaf70ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:18.523700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:18.528939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 195/389] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:18.566588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ea44-1249-4326-8163-d6f074e21154 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:18.704240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ea44-1249-4326-8163-d6f074e21154 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:18.742601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824dbf-9b53-4404-9eaa-c4371158205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:18.743427 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824dbf-9b53-4404-9eaa-c4371158205a None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:18.743714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824dbf-9b53-4404-9eaa-c4371158205a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:18.743995 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824dbf-9b53-4404-9eaa-c4371158205a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:18.757586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef824dbf-9b53-4404-9eaa-c4371158205a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-ef824dbf-9b53-4404-9eaa-c4371158205a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:18.767176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:18.768159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:18.768974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:18.771743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 195/390] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:36:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:18.777694 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eccfde-93bd-48c8-98d1-809dbaf70ec4 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:18.890466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eccfde-93bd-48c8-98d1-809dbaf70ec4 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:18.934775 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:18.935811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:18.936304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:18.936785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:18.937769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:18.938367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:18.940003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:18.949775 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 196/391] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:18.955871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824dbf-9b53-4404-9eaa-c4371158205a None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:19.015437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:19.071691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824dbf-9b53-4404-9eaa-c4371158205a None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:19.110937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c61cf-29ae-4833-b335-15fb955bcec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:19.111807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c61cf-29ae-4833-b335-15fb955bcec7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:19.112101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c61cf-29ae-4833-b335-15fb955bcec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:19.112386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c61cf-29ae-4833-b335-15fb955bcec7 None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:19.113623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c61cf-29ae-4833-b335-15fb955bcec7 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:19.115160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c61cf-29ae-4833-b335-15fb955bcec7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:19.117135 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 196/392] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:18 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:19.122693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:19.207696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:19.259678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103a85a-a9b7-41bc-980f-f00cfc460a7b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:19.302621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1ca2-a94e-4470-92bb-a310d4bfaa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:19.303509 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1ca2-a94e-4470-92bb-a310d4bfaa32 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:19.303797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1ca2-a94e-4470-92bb-a310d4bfaa32 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:19.304082 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1ca2-a94e-4470-92bb-a310d4bfaa32 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:19.305311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1ca2-a94e-4470-92bb-a310d4bfaa32 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:19.306816 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1ca2-a94e-4470-92bb-a310d4bfaa32 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:19.309401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 197/393] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:19 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:19.315057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c61cf-29ae-4833-b335-15fb955bcec7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:19.464467 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c61cf-29ae-4833-b335-15fb955bcec7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:19.486274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:19.509185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4aec09-46aa-4c71-b0ad-cfdea2913eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:19.510100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aec09-46aa-4c71-b0ad-cfdea2913eda None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:19.510390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aec09-46aa-4c71-b0ad-cfdea2913eda None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:19.510694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aec09-46aa-4c71-b0ad-cfdea2913eda None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856/groups/2c2adb1b01134a6587b3912727440804/roles/7252c7aaa32c4c28b47eedca12cee086` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:19.514986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4aec09-46aa-4c71-b0ad-cfdea2913eda None admin] RBAC: Authorizing `identity:create_grant(project_id=37e3413dfe4e45d486e2cfee347f9856, group_id=2c2adb1b01134a6587b3912727440804, role_id=7252c7aaa32c4c28b47eedca12cee086)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:19.516443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4aec09-46aa-4c71-b0ad-cfdea2913eda None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:19.540209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 197/394] 10.222.0.13 () {58 vars in 1442 bytes} [Wed May 25 13:36:19 2022] PUT /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856/groups/2c2adb1b01134a6587b3912727440804/roles/7252c7aaa32c4c28b47eedca12cee086 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:19.801592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998943-7200-4069-8321-35dc8eb307ab None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:19.802108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998943-7200-4069-8321-35dc8eb307ab None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:19.802324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998943-7200-4069-8321-35dc8eb307ab None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:19.803912 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 198/395] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:19.809614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cfed-d008-4a45-a1f7-0d668e057044 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:19.809958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cfed-d008-4a45-a1f7-0d668e057044 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:19.810253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760cfed-d008-4a45-a1f7-0d668e057044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:19.830947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-f760cfed-d008-4a45-a1f7-0d668e057044 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:19.832177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f760cfed-d008-4a45-a1f7-0d668e057044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:19.920783 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 198/396] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:19.944550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01998943-7200-4069-8321-35dc8eb307ab None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:20.056882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01998943-7200-4069-8321-35dc8eb307ab None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:20.087700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:20.093399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3bab-bbe0-472f-8318-413f047fd5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:20.094235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3bab-bbe0-472f-8318-413f047fd5bd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.094525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3bab-bbe0-472f-8318-413f047fd5bd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.094801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3bab-bbe0-472f-8318-413f047fd5bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.106311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b3bab-bbe0-472f-8318-413f047fd5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-1b7b3bab-bbe0-472f-8318-413f047fd5bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:20.114373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:20.115382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:20.116219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:20.118470 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 199/397] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:20.122274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760cfed-d008-4a45-a1f7-0d668e057044 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:20.268597 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760cfed-d008-4a45-a1f7-0d668e057044 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:20.278694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:20.311716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c98d6b-18aa-407a-8301-66fe3769335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:20.312311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c98d6b-18aa-407a-8301-66fe3769335f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.312595 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c98d6b-18aa-407a-8301-66fe3769335f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.312873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c98d6b-18aa-407a-8301-66fe3769335f None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.313630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c98d6b-18aa-407a-8301-66fe3769335f None admin] RBAC: Adding query filter params (name=member) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:20.313963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c98d6b-18aa-407a-8301-66fe3769335f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:20.315342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c98d6b-18aa-407a-8301-66fe3769335f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:20.327054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 199/398] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:20.333790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3bab-bbe0-472f-8318-413f047fd5bd None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:20.350300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b997a4-8be5-4b51-8af0-1975eddf42d7 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.350641 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b997a4-8be5-4b51-8af0-1975eddf42d7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.350880 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b997a4-8be5-4b51-8af0-1975eddf42d7 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.352699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 200/399] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:36:20.362026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd82-2f85-4b9f-af18-ee1eeb9b2eb2 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.362328 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd82-2f85-4b9f-af18-ee1eeb9b2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.362736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1cd82-2f85-4b9f-af18-ee1eeb9b2eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.384139 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-39c1cd82-2f85-4b9f-af18-ee1eeb9b2eb2 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:20.385468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-39c1cd82-2f85-4b9f-af18-ee1eeb9b2eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:20.473442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 201/400] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:20.513260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3bab-bbe0-472f-8318-413f047fd5bd None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:20.515773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1cd82-2f85-4b9f-af18-ee1eeb9b2eb2 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:20.557356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f12ec-b544-4706-bd80-bc1e0fece2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:20.559168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f12ec-b544-4706-bd80-bc1e0fece2a2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.559684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f12ec-b544-4706-bd80-bc1e0fece2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.560159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f12ec-b544-4706-bd80-bc1e0fece2a2 None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.562806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f12ec-b544-4706-bd80-bc1e0fece2a2 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:20.564616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f12ec-b544-4706-bd80-bc1e0fece2a2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:20.567498 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 200/401] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:20 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:20.572730 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f12ec-b544-4706-bd80-bc1e0fece2a2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:20.679671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:20.689657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:20.694709 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1cd82-2f85-4b9f-af18-ee1eeb9b2eb2 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:20.736702 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f12ec-b544-4706-bd80-bc1e0fece2a2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:20.738059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67674a-3f28-4532-b214-0afd948b4304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:20.739219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67674a-3f28-4532-b214-0afd948b4304 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.740428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67674a-3f28-4532-b214-0afd948b4304 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.740873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67674a-3f28-4532-b214-0afd948b4304 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.754797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67674a-3f28-4532-b214-0afd948b4304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-3b67674a-3f28-4532-b214-0afd948b4304 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:20.764974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:20.765931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:20.766757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:20.773500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 202/402] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:20.773500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e1be-03f3-4b2e-ad8c-fc3a1fec8092 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.773500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e1be-03f3-4b2e-ad8c-fc3a1fec8092 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.773500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e1be-03f3-4b2e-ad8c-fc3a1fec8092 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.773500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 203/403] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:20.775318 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e1be-03f3-4b2e-ad8c-fc3a1fec8092 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:20.788445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963dde-f730-4868-9206-db2e63b6920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:20.789323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963dde-f730-4868-9206-db2e63b6920d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.789612 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963dde-f730-4868-9206-db2e63b6920d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.789943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963dde-f730-4868-9206-db2e63b6920d None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.791155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50963dde-f730-4868-9206-db2e63b6920d None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:20.793197 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50963dde-f730-4868-9206-db2e63b6920d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:20.798711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 201/404] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:20 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:20.800024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee849-7b95-4cc2-80f6-42299d76949f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.800319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee849-7b95-4cc2-80f6-42299d76949f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.800918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee849-7b95-4cc2-80f6-42299d76949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.819029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-6b0ee849-7b95-4cc2-80f6-42299d76949f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:20.820162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-6b0ee849-7b95-4cc2-80f6-42299d76949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:20.896115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e1be-03f3-4b2e-ad8c-fc3a1fec8092 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:20.899699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 202/405] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:20.901047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ee849-7b95-4cc2-80f6-42299d76949f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:20.937026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:20.938160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:20.938824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:20.939314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:20.940331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:20.940891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:20.943063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:20.954029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 204/406] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:20.955190 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:20.984435 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:21.004772 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:21.057514 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ee849-7b95-4cc2-80f6-42299d76949f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:21.072440 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933e7f5-d121-4ae2-96d6-7d332228fe15 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:21.096113 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af7f7-ff8c-4213-ba8b-ba4722341d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:21.096932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af7f7-ff8c-4213-ba8b-ba4722341d9f None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.097238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af7f7-ff8c-4213-ba8b-ba4722341d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.097496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af7f7-ff8c-4213-ba8b-ba4722341d9f None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738/groups/2c2adb1b01134a6587b3912727440804/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.099748 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60af7f7-ff8c-4213-ba8b-ba4722341d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=0388b88e9f734e8a8e7feadddec96738, group_id=2c2adb1b01134a6587b3912727440804, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:21.101182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60af7f7-ff8c-4213-ba8b-ba4722341d9f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:21.112908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01a239-d77b-45b7-b6f4-46620d6e9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:21.114137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a239-d77b-45b7-b6f4-46620d6e9db8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.114644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a239-d77b-45b7-b6f4-46620d6e9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.115159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a239-d77b-45b7-b6f4-46620d6e9db8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.118215 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 203/407] 10.222.0.13 () {58 vars in 1442 bytes} [Wed May 25 13:36:20 2022] PUT /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738/groups/2c2adb1b01134a6587b3912727440804/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:21.119570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af7f7-ff8c-4213-ba8b-ba4722341d9f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:21.129763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01a239-d77b-45b7-b6f4-46620d6e9db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-7d01a239-d77b-45b7-b6f4-46620d6e9db8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:21.139511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:21.140494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:21.141374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:21.144415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 205/408] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:36:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:21.158127 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01a239-d77b-45b7-b6f4-46620d6e9db8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:21.260382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af7f7-ff8c-4213-ba8b-ba4722341d9f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:21.283835 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:21.308921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95b32-6fea-4cbd-8300-51424f429435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:21.310267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95b32-6fea-4cbd-8300-51424f429435 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.310701 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95b32-6fea-4cbd-8300-51424f429435 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.311122 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95b32-6fea-4cbd-8300-51424f429435 None admin] PATH_INFO: `/v3/groups/e11a33e2d5d545c9ac0a72fe8f67dbac` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.312840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b95b32-6fea-4cbd-8300-51424f429435 None admin] RBAC: Authorizing `identity:get_group(group_id=e11a33e2d5d545c9ac0a72fe8f67dbac)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:21.314528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b95b32-6fea-4cbd-8300-51424f429435 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:21.317414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 204/409] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:21 2022] GET /identity/v3/groups/e11a33e2d5d545c9ac0a72fe8f67dbac => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:21.323028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95b32-6fea-4cbd-8300-51424f429435 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:21.342295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:21.373013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01a239-d77b-45b7-b6f4-46620d6e9db8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:21.422087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69811700-7716-4bed-8c81-878c35653658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:21.422779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811700-7716-4bed-8c81-878c35653658 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.423066 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811700-7716-4bed-8c81-878c35653658 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.423345 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811700-7716-4bed-8c81-878c35653658 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.424104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69811700-7716-4bed-8c81-878c35653658 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:21.424414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69811700-7716-4bed-8c81-878c35653658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:21.425899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69811700-7716-4bed-8c81-878c35653658 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:21.435830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 206/410] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:21.437144 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab41f4-00c6-4baa-a34a-a269feccbcbe None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.437436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab41f4-00c6-4baa-a34a-a269feccbcbe None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.437719 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab41f4-00c6-4baa-a34a-a269feccbcbe None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.444011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 207/411] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:21.444806 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab41f4-00c6-4baa-a34a-a269feccbcbe None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:21.453837 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95b32-6fea-4cbd-8300-51424f429435 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:21.492136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3e241-b52b-49c5-8502-93a754581711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:21.493484 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e241-b52b-49c5-8502-93a754581711 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.494125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e241-b52b-49c5-8502-93a754581711 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.494553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e241-b52b-49c5-8502-93a754581711 None admin] PATH_INFO: `/v3/projects/48375e55fddc4df099c1a83243da1d15` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.496459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e241-b52b-49c5-8502-93a754581711 None admin] RBAC: Authorizing `identity:get_project(project_id=48375e55fddc4df099c1a83243da1d15)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:21.498309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e241-b52b-49c5-8502-93a754581711 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:21.500591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 205/412] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:21 2022] GET /identity/v3/projects/48375e55fddc4df099c1a83243da1d15 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:21.502103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483239df-b57c-46ec-b281-7bfe58a1d18a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.502531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483239df-b57c-46ec-b281-7bfe58a1d18a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.502939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483239df-b57c-46ec-b281-7bfe58a1d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.523203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-483239df-b57c-46ec-b281-7bfe58a1d18a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:21.524398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-483239df-b57c-46ec-b281-7bfe58a1d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:21.570750 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab41f4-00c6-4baa-a34a-a269feccbcbe None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:21.578280 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:21.599938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 206/413] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:21.600754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483239df-b57c-46ec-b281-7bfe58a1d18a None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:21.626172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2c8c-204a-414b-9909-b719887ad643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:21.627472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2c8c-204a-414b-9909-b719887ad643 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.628075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2c8c-204a-414b-9909-b719887ad643 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.628554 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2c8c-204a-414b-9909-b719887ad643 None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.630152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d2c8c-204a-414b-9909-b719887ad643 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:21.632041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d2c8c-204a-414b-9909-b719887ad643 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:21.634331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 208/414] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:21 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:21.640340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2c8c-204a-414b-9909-b719887ad643 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:21.654868 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:21.708546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483239df-b57c-46ec-b281-7bfe58a1d18a None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:21.755173 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a66eb-4cfd-4cae-8357-8df1af8ef4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:21.755547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2c8c-204a-414b-9909-b719887ad643 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:21.756512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a66eb-4cfd-4cae-8357-8df1af8ef4a0 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.756941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a66eb-4cfd-4cae-8357-8df1af8ef4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.757607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a66eb-4cfd-4cae-8357-8df1af8ef4a0 None admin] PATH_INFO: `/v3/projects/48375e55fddc4df099c1a83243da1d15/groups/e11a33e2d5d545c9ac0a72fe8f67dbac/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.761271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a66eb-4cfd-4cae-8357-8df1af8ef4a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=48375e55fddc4df099c1a83243da1d15, group_id=e11a33e2d5d545c9ac0a72fe8f67dbac, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:21.762964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a66eb-4cfd-4cae-8357-8df1af8ef4a0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:21.786426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 207/415] 10.222.0.13 () {58 vars in 1442 bytes} [Wed May 25 13:36:21 2022] PUT /identity/v3/projects/48375e55fddc4df099c1a83243da1d15/groups/e11a33e2d5d545c9ac0a72fe8f67dbac/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:21.788069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a66eb-4cfd-4cae-8357-8df1af8ef4a0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:21.819644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f564-d3ef-4e32-a88c-982a05a72858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:21.821750 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f564-d3ef-4e32-a88c-982a05a72858 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:21.823923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f564-d3ef-4e32-a88c-982a05a72858 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:21.825830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f564-d3ef-4e32-a88c-982a05a72858 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:21.861953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417f564-d3ef-4e32-a88c-982a05a72858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-2417f564-d3ef-4e32-a88c-982a05a72858 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:21.879385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:21.880633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:21.881515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:21.888716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 209/416] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:21.894956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f564-d3ef-4e32-a88c-982a05a72858 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:21.911529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:22.031206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:22.033364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a66eb-4cfd-4cae-8357-8df1af8ef4a0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:22.080788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f564-d3ef-4e32-a88c-982a05a72858 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:22.084512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda717b6-5c0a-4854-8377-98cb82cf3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:22.085933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda717b6-5c0a-4854-8377-98cb82cf3567 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:22.086449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda717b6-5c0a-4854-8377-98cb82cf3567 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:22.086950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda717b6-5c0a-4854-8377-98cb82cf3567 None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:22.089483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda717b6-5c0a-4854-8377-98cb82cf3567 None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:22.091699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda717b6-5c0a-4854-8377-98cb82cf3567 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:22.094773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 208/417] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:21 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:22.101324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda717b6-5c0a-4854-8377-98cb82cf3567 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:22.125030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:22.126351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:22.127303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:22.127763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:22.128712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] RBAC: Adding query filter params (name=member) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:22.129216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:22.131698 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:22.144789 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 210/418] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:22.150437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:22.281661 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda717b6-5c0a-4854-8377-98cb82cf3567 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:22.310120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:22.339080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe22f7-88be-4c9b-a15a-f696978a5daf None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:22.354125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af8af6-c65a-4e84-b7b5-dfc60c86c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:22.355142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8af6-c65a-4e84-b7b5-dfc60c86c75a None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:22.355432 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8af6-c65a-4e84-b7b5-dfc60c86c75a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:22.355710 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8af6-c65a-4e84-b7b5-dfc60c86c75a None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738/groups/2c2adb1b01134a6587b3912727440804/roles/7252c7aaa32c4c28b47eedca12cee086` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:22.359721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af8af6-c65a-4e84-b7b5-dfc60c86c75a None admin] RBAC: Authorizing `identity:create_grant(project_id=0388b88e9f734e8a8e7feadddec96738, group_id=2c2adb1b01134a6587b3912727440804, role_id=7252c7aaa32c4c28b47eedca12cee086)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:22.361240 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af8af6-c65a-4e84-b7b5-dfc60c86c75a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:22.391489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:22.402029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d21f0-8f04-4897-8258-66ccff08c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:22.402740 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d21f0-8f04-4897-8258-66ccff08c23f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:22.403039 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d21f0-8f04-4897-8258-66ccff08c23f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:22.403325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d21f0-8f04-4897-8258-66ccff08c23f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:22.404140 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 209/419] 10.222.0.13 () {58 vars in 1442 bytes} [Wed May 25 13:36:22 2022] PUT /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738/groups/2c2adb1b01134a6587b3912727440804/roles/7252c7aaa32c4c28b47eedca12cee086 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:36:22.488158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d21f0-8f04-4897-8258-66ccff08c23f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:22.489667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d21f0-8f04-4897-8258-66ccff08c23f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:22.595031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16ca5-f611-4280-bdf3-11e6a787abc0 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:22.595401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16ca5-f611-4280-bdf3-11e6a787abc0 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:22.595607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16ca5-f611-4280-bdf3-11e6a787abc0 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:22.597240 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 210/420] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:36:22.602744 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16cd6b-e398-4105-afaf-3e7563c2f18d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:22.603050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16cd6b-e398-4105-afaf-3e7563c2f18d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:22.603314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16cd6b-e398-4105-afaf-3e7563c2f18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:22.603937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 211/421] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:22.609896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d21f0-8f04-4897-8258-66ccff08c23f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:22.643483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:22.650825 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-8f16cd6b-e398-4105-afaf-3e7563c2f18d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:22.652099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-8f16cd6b-e398-4105-afaf-3e7563c2f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:22.716342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d21f0-8f04-4897-8258-66ccff08c23f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:22.746565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 211/422] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:22.752057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc61291-b54b-4efc-b3b4-182db406c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:22.752915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc61291-b54b-4efc-b3b4-182db406c070 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:22.753195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc61291-b54b-4efc-b3b4-182db406c070 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:22.753466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc61291-b54b-4efc-b3b4-182db406c070 None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:22.754708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc61291-b54b-4efc-b3b4-182db406c070 None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:22.756159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc61291-b54b-4efc-b3b4-182db406c070 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:22.758142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 212/423] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:22 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:22.763472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16cd6b-e398-4105-afaf-3e7563c2f18d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:22.778948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc61291-b54b-4efc-b3b4-182db406c070 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:22.882094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:22.886210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16cd6b-e398-4105-afaf-3e7563c2f18d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:22.925186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0d06-369e-491f-9df3-71b9dfb4411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:22.926048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0d06-369e-491f-9df3-71b9dfb4411d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:22.926337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0d06-369e-491f-9df3-71b9dfb4411d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:22.926617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0d06-369e-491f-9df3-71b9dfb4411d None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:22.927840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f0d06-369e-491f-9df3-71b9dfb4411d None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:22.929621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f0d06-369e-491f-9df3-71b9dfb4411d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:22.931612 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 212/424] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:22 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:22.938193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0d06-369e-491f-9df3-71b9dfb4411d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:22.983680 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:22.987789 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc61291-b54b-4efc-b3b4-182db406c070 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:23.028191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700b2b8-2310-47f8-ae73-3342c6d11b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:23.029383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b2b8-2310-47f8-ae73-3342c6d11b29 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:23.030022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b2b8-2310-47f8-ae73-3342c6d11b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:23.030517 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b2b8-2310-47f8-ae73-3342c6d11b29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:23.043499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700b2b8-2310-47f8-ae73-3342c6d11b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-e700b2b8-2310-47f8-ae73-3342c6d11b29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:23.052729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:23.053646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:23.054496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:23.057372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 213/425] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:36:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:23.063424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700b2b8-2310-47f8-ae73-3342c6d11b29 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:23.180172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700b2b8-2310-47f8-ae73-3342c6d11b29 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:23.220811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:23.221904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:23.222516 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:23.223003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:23.223956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:23.224129 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0d06-369e-491f-9df3-71b9dfb4411d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:23.224664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:23.226459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:23.241757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 214/426] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:23.244218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:23.271989 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:23.318452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:23.319133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:23.319415 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:23.319700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:23.320550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] RBAC: Adding query filter params (group.id=2c2adb1b01134a6587b3912727440804, role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=37e3413dfe4e45d486e2cfee347f9856) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:23.320872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:23.325761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:23.333036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 213/427] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:22 2022] GET /identity/v3/role_assignments?group.id=2c2adb1b01134a6587b3912727440804&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 611 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:23.379028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776c34b-5803-489d-a920-e6b0e357fb4e None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:23.424821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139ee7a-d628-4354-9422-21780ce81229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:23.425482 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ee7a-d628-4354-9422-21780ce81229 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:23.425797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ee7a-d628-4354-9422-21780ce81229 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:23.426087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ee7a-d628-4354-9422-21780ce81229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:23.517843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139ee7a-d628-4354-9422-21780ce81229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:23.519334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139ee7a-d628-4354-9422-21780ce81229 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:23.551561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:23.643574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 215/428] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:36:23.649922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:23.685820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:23.774191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf810b-5b31-460d-b3e8-8af9872bc2af None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:23.793898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2301-8f78-43f8-a8cc-619293f6846b None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:23.794548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2301-8f78-43f8-a8cc-619293f6846b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:23.797052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2301-8f78-43f8-a8cc-619293f6846b None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:23.804849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 216/429] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:23.810848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec3b5-a087-4796-a800-94b9a649d161 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:23.811246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec3b5-a087-4796-a800-94b9a649d161 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:23.811539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec3b5-a087-4796-a800-94b9a649d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:23.814478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bc10-2e47-4464-bf37-7277a420d3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:23.815354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bc10-2e47-4464-bf37-7277a420d3ba None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:23.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bc10-2e47-4464-bf37-7277a420d3ba None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:23.815930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bc10-2e47-4464-bf37-7277a420d3ba None admin] PATH_INFO: `/v3/projects/37e3413dfe4e45d486e2cfee347f9856` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:23.817141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679bc10-2e47-4464-bf37-7277a420d3ba None admin] RBAC: Authorizing `identity:get_project(project_id=37e3413dfe4e45d486e2cfee347f9856)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:23.818650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679bc10-2e47-4464-bf37-7277a420d3ba None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:23.820825 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 214/430] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:23 2022] GET /identity/v3/projects/37e3413dfe4e45d486e2cfee347f9856 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:23.826390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bc10-2e47-4464-bf37-7277a420d3ba None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:23.839138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-61eec3b5-a087-4796-a800-94b9a649d161 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:23.840686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-61eec3b5-a087-4796-a800-94b9a649d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:23.923672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 217/431] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:23.937520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:23.941425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bc10-2e47-4464-bf37-7277a420d3ba None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:23.949607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eec3b5-a087-4796-a800-94b9a649d161 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:23.983387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77b10-d555-46e4-8110-c703443c7d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:23.984266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77b10-d555-46e4-8110-c703443c7d4e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:23.984558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77b10-d555-46e4-8110-c703443c7d4e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:23.984844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77b10-d555-46e4-8110-c703443c7d4e None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:23.986205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd77b10-d555-46e4-8110-c703443c7d4e None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:23.987691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd77b10-d555-46e4-8110-c703443c7d4e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:23.989843 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 215/432] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:23 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:23.997768 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77b10-d555-46e4-8110-c703443c7d4e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:24.037191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:24.100667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eec3b5-a087-4796-a800-94b9a649d161 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:24.119448 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77b10-d555-46e4-8110-c703443c7d4e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:24.148063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd0744-d5b5-4712-97d5-e465ed59c48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:24.149409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd0744-d5b5-4712-97d5-e465ed59c48b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:24.150325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd0744-d5b5-4712-97d5-e465ed59c48b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:24.150928 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd0744-d5b5-4712-97d5-e465ed59c48b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:24.159977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:24.160652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:24.160944 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:24.161230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:24.162119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] RBAC: Adding query filter params (group.id=2c2adb1b01134a6587b3912727440804, role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=37e3413dfe4e45d486e2cfee347f9856) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:24.164643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:24.165262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd0744-d5b5-4712-97d5-e465ed59c48b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:24.166241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:24.174831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 216/433] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:23 2022] GET /identity/v3/role_assignments?group.id=2c2adb1b01134a6587b3912727440804&scope.project.id=37e3413dfe4e45d486e2cfee347f9856&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-50fd0744-d5b5-4712-97d5-e465ed59c48b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:24.175580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:24.176526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:24.177363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 218/434] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:24.183217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:24.242168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:24.303137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc35d0d-8565-4fbf-9c92-b7ffd03da847 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:24.346191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50ab4f-5ecb-4f16-a906-6f601e7b76e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:24.346904 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ab4f-5ecb-4f16-a906-6f601e7b76e0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:24.347196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ab4f-5ecb-4f16-a906-6f601e7b76e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:24.347478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ab4f-5ecb-4f16-a906-6f601e7b76e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:24.348255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ab4f-5ecb-4f16-a906-6f601e7b76e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:24.348570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ab4f-5ecb-4f16-a906-6f601e7b76e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:24.350036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ab4f-5ecb-4f16-a906-6f601e7b76e0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:24.360520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 217/435] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:36:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:24.367132 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd0744-d5b5-4712-97d5-e465ed59c48b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:24.490745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd0744-d5b5-4712-97d5-e465ed59c48b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:24.504821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:24.506709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d28e-b1e0-4581-8b25-64020806bb8c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:24.507013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d28e-b1e0-4581-8b25-64020806bb8c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:24.507353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d28e-b1e0-4581-8b25-64020806bb8c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:24.510565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 218/436] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:36:24.514859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d5b1-9791-4341-a262-65c2fe68a72d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:24.515162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d5b1-9791-4341-a262-65c2fe68a72d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:24.515450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d5b1-9791-4341-a262-65c2fe68a72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:24.529695 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea179a0-639b-468c-bb33-3ed013be2f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:24.530756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea179a0-639b-468c-bb33-3ed013be2f13 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:24.531243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea179a0-639b-468c-bb33-3ed013be2f13 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:24.531740 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea179a0-639b-468c-bb33-3ed013be2f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:24.533882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-d609d5b1-9791-4341-a262-65c2fe68a72d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:24.535097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-d609d5b1-9791-4341-a262-65c2fe68a72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:24.623350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea179a0-639b-468c-bb33-3ed013be2f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:24.625450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea179a0-639b-468c-bb33-3ed013be2f13 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:24.629825 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 219/437] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:24.649916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d5b1-9791-4341-a262-65c2fe68a72d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:24.682137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:24.763918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 219/438] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:24.769951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea179a0-639b-468c-bb33-3ed013be2f13 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:24.778674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d5b1-9791-4341-a262-65c2fe68a72d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:24.788883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:24.823788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6227b8-3011-43a2-8bdd-251949087e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:24.824711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6227b8-3011-43a2-8bdd-251949087e21 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:24.825077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6227b8-3011-43a2-8bdd-251949087e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:24.825369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6227b8-3011-43a2-8bdd-251949087e21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:24.835993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6227b8-3011-43a2-8bdd-251949087e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-0b6227b8-3011-43a2-8bdd-251949087e21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:24.844561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:24.845473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:24.846328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:24.848596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 220/439] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:24.853984 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6227b8-3011-43a2-8bdd-251949087e21 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:24.889547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea179a0-639b-468c-bb33-3ed013be2f13 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:24.924856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c971f-85bf-4125-a292-ea5e9103c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:24.925723 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c971f-85bf-4125-a292-ea5e9103c6cc None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:24.926043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c971f-85bf-4125-a292-ea5e9103c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:24.926342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c971f-85bf-4125-a292-ea5e9103c6cc None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:24.928543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c971f-85bf-4125-a292-ea5e9103c6cc None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:24.930024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c971f-85bf-4125-a292-ea5e9103c6cc None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:24.931764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 220/440] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:24 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:24.937117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c971f-85bf-4125-a292-ea5e9103c6cc None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:24.947058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:24.966692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6227b8-3011-43a2-8bdd-251949087e21 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.005224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.005943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.006236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.006520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.007284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:25.007601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.009009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:25.018326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 221/441] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:25.023974 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:25.030268 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:25.052974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c971f-85bf-4125-a292-ea5e9103c6cc None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.090398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0b0e-1511-4c9b-8bce-f2b0d6cd240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.091263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0b0e-1511-4c9b-8bce-f2b0d6cd240a None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.091550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0b0e-1511-4c9b-8bce-f2b0d6cd240a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.091829 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0b0e-1511-4c9b-8bce-f2b0d6cd240a None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.093158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b0b0e-1511-4c9b-8bce-f2b0d6cd240a None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.094913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b0b0e-1511-4c9b-8bce-f2b0d6cd240a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:25.096468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 221/442] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:24 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:25.102126 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0b0e-1511-4c9b-8bce-f2b0d6cd240a None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:25.132163 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605707-4c34-47cb-abb5-175017b99a7f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.169473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c760-403d-4199-bf03-8679c3a69fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.170086 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c760-403d-4199-bf03-8679c3a69fe9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.170368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c760-403d-4199-bf03-8679c3a69fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.170647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c760-403d-4199-bf03-8679c3a69fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.187409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:25.214852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0b0e-1511-4c9b-8bce-f2b0d6cd240a None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.239769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c760-403d-4199-bf03-8679c3a69fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.241241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c760-403d-4199-bf03-8679c3a69fe9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:25.249016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d888c1-e320-44f8-9e49-c8bb375765a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.249984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d888c1-e320-44f8-9e49-c8bb375765a1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.250273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d888c1-e320-44f8-9e49-c8bb375765a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d888c1-e320-44f8-9e49-c8bb375765a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.251388 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d888c1-e320-44f8-9e49-c8bb375765a1 None admin] RBAC: Adding query filter params (group.id=2c2adb1b01134a6587b3912727440804, role.id=6076bee6c25b4df5bfbd3f00b06c314b, scope.project.id=0388b88e9f734e8a8e7feadddec96738) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:25.251702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d888c1-e320-44f8-9e49-c8bb375765a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.253138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d888c1-e320-44f8-9e49-c8bb375765a1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:25.259152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 222/443] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:25 2022] GET /identity/v3/role_assignments?group.id=2c2adb1b01134a6587b3912727440804&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=6076bee6c25b4df5bfbd3f00b06c314b => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:25.260360 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f553-126c-4dfd-9690-0255767c90f4 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.261218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f553-126c-4dfd-9690-0255767c90f4 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.261503 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f553-126c-4dfd-9690-0255767c90f4 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.262787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 223/444] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:25.268537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b6005-ee8c-4563-8e4c-4952a1fe71ac None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.268829 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b6005-ee8c-4563-8e4c-4952a1fe71ac None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.269114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b6005-ee8c-4563-8e4c-4952a1fe71ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.286763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-4a5b6005-ee8c-4563-8e4c-4952a1fe71ac None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:25.288009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-4a5b6005-ee8c-4563-8e4c-4952a1fe71ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:25.297068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:25.361182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 222/445] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:36:25.362226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c760-403d-4199-bf03-8679c3a69fe9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:25.371159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 224/446] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:25.398682 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b6005-ee8c-4563-8e4c-4952a1fe71ac None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:25.416818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:25.478736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c760-403d-4199-bf03-8679c3a69fe9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.515888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a09bc-913f-4791-b970-378f2e893863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.517039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a09bc-913f-4791-b970-378f2e893863 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.517325 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a09bc-913f-4791-b970-378f2e893863 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.517604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a09bc-913f-4791-b970-378f2e893863 None admin] PATH_INFO: `/v3/projects/48375e55fddc4df099c1a83243da1d15` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.518835 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a09bc-913f-4791-b970-378f2e893863 None admin] RBAC: Authorizing `identity:get_project(project_id=48375e55fddc4df099c1a83243da1d15)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.520405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a09bc-913f-4791-b970-378f2e893863 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:25.522137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 223/447] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:25 2022] GET /identity/v3/projects/48375e55fddc4df099c1a83243da1d15 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:25.527794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a09bc-913f-4791-b970-378f2e893863 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:25.531079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b6005-ee8c-4563-8e4c-4952a1fe71ac None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.571885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad529da-2dcc-46fe-91f8-3961f60b4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.572725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad529da-2dcc-46fe-91f8-3961f60b4706 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.572984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad529da-2dcc-46fe-91f8-3961f60b4706 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.576007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad529da-2dcc-46fe-91f8-3961f60b4706 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.587297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad529da-2dcc-46fe-91f8-3961f60b4706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-2ad529da-2dcc-46fe-91f8-3961f60b4706 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:25.595473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:25.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:25.597258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:25.602955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 225/448] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:36:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:25.605318 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad529da-2dcc-46fe-91f8-3961f60b4706 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:25.608288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:25.645226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a09bc-913f-4791-b970-378f2e893863 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.662048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:25.684120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835248a-aa01-484c-bba0-43da4243cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.684986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835248a-aa01-484c-bba0-43da4243cd89 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.685275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835248a-aa01-484c-bba0-43da4243cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.685562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835248a-aa01-484c-bba0-43da4243cd89 None admin] PATH_INFO: `/v3/groups/e11a33e2d5d545c9ac0a72fe8f67dbac` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.686820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835248a-aa01-484c-bba0-43da4243cd89 None admin] RBAC: Authorizing `identity:get_group(group_id=e11a33e2d5d545c9ac0a72fe8f67dbac)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.688282 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835248a-aa01-484c-bba0-43da4243cd89 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:25.690166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 224/449] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:25 2022] GET /identity/v3/groups/e11a33e2d5d545c9ac0a72fe8f67dbac => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:25.695874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835248a-aa01-484c-bba0-43da4243cd89 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:25.719021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad529da-2dcc-46fe-91f8-3961f60b4706 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.752241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.752821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.753109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.753382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.754164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:25.754471 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.755844 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:25.763607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 226/450] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:25.769149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:25.794357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835248a-aa01-484c-bba0-43da4243cd89 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.828357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.829017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.829289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.829565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.830452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] RBAC: Adding query filter params (group.id=e11a33e2d5d545c9ac0a72fe8f67dbac, role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=48375e55fddc4df099c1a83243da1d15) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:25.830766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.832212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:25.832920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:25.838590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 225/451] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:25 2022] GET /identity/v3/role_assignments?group.id=e11a33e2d5d545c9ac0a72fe8f67dbac&scope.project.id=48375e55fddc4df099c1a83243da1d15&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:25.874216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a92099-822e-47de-9cd1-8f03899e828a None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:25.910496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1141be-8e23-4c26-b104-08b6ab252204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:25.911157 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1141be-8e23-4c26-b104-08b6ab252204 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:25.911440 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1141be-8e23-4c26-b104-08b6ab252204 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:25.911714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1141be-8e23-4c26-b104-08b6ab252204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:25.983069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1141be-8e23-4c26-b104-08b6ab252204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:25.984550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1141be-8e23-4c26-b104-08b6ab252204 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:26.048198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:26.089157 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 227/452] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:36:26.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:26.143860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:26.195986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e5d78-b52c-4453-88bd-d398ca52cbfb None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:26.228221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33848-cf4f-4191-a37a-ab2befa27d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:26.229061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33848-cf4f-4191-a37a-ab2befa27d0a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:26.229901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33848-cf4f-4191-a37a-ab2befa27d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:26.230186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33848-cf4f-4191-a37a-ab2befa27d0a None admin] PATH_INFO: `/v3/projects/0388b88e9f734e8a8e7feadddec96738` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:26.231338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a33848-cf4f-4191-a37a-ab2befa27d0a None admin] RBAC: Authorizing `identity:get_project(project_id=0388b88e9f734e8a8e7feadddec96738)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:26.232792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a33848-cf4f-4191-a37a-ab2befa27d0a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:26.234504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 226/453] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:36:26 2022] GET /identity/v3/projects/0388b88e9f734e8a8e7feadddec96738 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:26.239965 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1141be-8e23-4c26-b104-08b6ab252204 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:26.335039 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1141be-8e23-4c26-b104-08b6ab252204 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:26.367704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edaa09-8485-4500-859d-3fe66bfb57d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:26.368545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edaa09-8485-4500-859d-3fe66bfb57d9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:26.368831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edaa09-8485-4500-859d-3fe66bfb57d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:26.369110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edaa09-8485-4500-859d-3fe66bfb57d9 None admin] PATH_INFO: `/v3/groups/2c2adb1b01134a6587b3912727440804` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:26.370332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edaa09-8485-4500-859d-3fe66bfb57d9 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2adb1b01134a6587b3912727440804)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:26.371766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edaa09-8485-4500-859d-3fe66bfb57d9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:26.373375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 228/454] 10.222.0.13 () {56 vars in 1180 bytes} [Wed May 25 13:36:26 2022] GET /identity/v3/groups/2c2adb1b01134a6587b3912727440804 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:26.379143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33848-cf4f-4191-a37a-ab2befa27d0a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:26.474465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33848-cf4f-4191-a37a-ab2befa27d0a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:26.487891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:26.507107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa3d1-44eb-4d3a-b89e-dfa5fd1a88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:26.507764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa3d1-44eb-4d3a-b89e-dfa5fd1a88f9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:26.508030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa3d1-44eb-4d3a-b89e-dfa5fd1a88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:26.508305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa3d1-44eb-4d3a-b89e-dfa5fd1a88f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:26.509124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa3d1-44eb-4d3a-b89e-dfa5fd1a88f9 None admin] RBAC: Adding query filter params (group.id=2c2adb1b01134a6587b3912727440804, role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=0388b88e9f734e8a8e7feadddec96738) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:26.509433 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa3d1-44eb-4d3a-b89e-dfa5fd1a88f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:26.511434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa3d1-44eb-4d3a-b89e-dfa5fd1a88f9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:26.517067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 227/455] 10.222.0.13 () {56 vars in 1376 bytes} [Wed May 25 13:36:26 2022] GET /identity/v3/role_assignments?group.id=2c2adb1b01134a6587b3912727440804&scope.project.id=0388b88e9f734e8a8e7feadddec96738&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:29.313544 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25a9b8-36ac-434e-ac1a-4d46318f5f33 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.314628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25a9b8-36ac-434e-ac1a-4d46318f5f33 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.315122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25a9b8-36ac-434e-ac1a-4d46318f5f33 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.317003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 229/456] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:29.322205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffec5e-08a7-47f2-b81e-c624b7cf2208 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.323069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffec5e-08a7-47f2-b81e-c624b7cf2208 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.323565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffec5e-08a7-47f2-b81e-c624b7cf2208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.346770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-57ffec5e-08a7-47f2-b81e-c624b7cf2208 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:29.348350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-57ffec5e-08a7-47f2-b81e-c624b7cf2208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:29.447117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 228/457] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:29.497377 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25a9b8-36ac-434e-ac1a-4d46318f5f33 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:29.540053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:29.555301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1fe65-964a-4b9e-bae2-b1ef67544aae None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.555640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1fe65-964a-4b9e-bae2-b1ef67544aae None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.555868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1fe65-964a-4b9e-bae2-b1ef67544aae None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.557354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 229/458] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:36:29.563775 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf91269-1f39-46b9-aefc-a79739c48865 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.563988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf91269-1f39-46b9-aefc-a79739c48865 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.564430 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf91269-1f39-46b9-aefc-a79739c48865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.606895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-cdf91269-1f39-46b9-aefc-a79739c48865 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:29.608367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-cdf91269-1f39-46b9-aefc-a79739c48865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:29.640021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25a9b8-36ac-434e-ac1a-4d46318f5f33 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:29.689553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 230/459] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:29.707379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:29.708190 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.708472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.708748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.714767 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf91269-1f39-46b9-aefc-a79739c48865 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:29.729117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:29.731174 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:29.763053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:29.764021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:29.764878 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:29.764878 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:29.764878 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:29.764878 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:29.764878 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 230/460] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:29.771458 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:29.791217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:29.870200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf91269-1f39-46b9-aefc-a79739c48865 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:29.883720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:29.903350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275c8e-ddc9-47ea-aff1-c17fa1353056 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:29.905260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca68a6a-d293-4c92-aa06-32b5d504808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:29.906098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68a6a-d293-4c92-aa06-32b5d504808c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.906389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68a6a-d293-4c92-aa06-32b5d504808c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.906671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68a6a-d293-4c92-aa06-32b5d504808c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.917904 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca68a6a-d293-4c92-aa06-32b5d504808c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:29.919388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca68a6a-d293-4c92-aa06-32b5d504808c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-7ca68a6a-d293-4c92-aa06-32b5d504808c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:29.937588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:29.938647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:29.939521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:29.939521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:29.939521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:29.939521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:29.939521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 231/461] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:29.945161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b59fb-1e97-474e-8f7a-a2e215e7184d None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.945161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b59fb-1e97-474e-8f7a-a2e215e7184d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.945161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b59fb-1e97-474e-8f7a-a2e215e7184d None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.945161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 232/462] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:29.948467 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b59fb-1e97-474e-8f7a-a2e215e7184d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:29.952549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f1c1-c82f-4955-ae85-ffba9cf0c3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:29.953324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f1c1-c82f-4955-ae85-ffba9cf0c3ed None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.953615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f1c1-c82f-4955-ae85-ffba9cf0c3ed None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.953926 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f1c1-c82f-4955-ae85-ffba9cf0c3ed None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.954673 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f1c1-c82f-4955-ae85-ffba9cf0c3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:29.954984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f1c1-c82f-4955-ae85-ffba9cf0c3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:29.956365 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f1c1-c82f-4955-ae85-ffba9cf0c3ed None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:29.970411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 231/463] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:29.971753 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d253c-8034-4662-a2da-49f880310ca9 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:29.972054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d253c-8034-4662-a2da-49f880310ca9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:29.972339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d253c-8034-4662-a2da-49f880310ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:29.994789 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b42d253c-8034-4662-a2da-49f880310ca9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:29.996518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b42d253c-8034-4662-a2da-49f880310ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:30.054808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:30.067714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b59fb-1e97-474e-8f7a-a2e215e7184d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:30.077793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 232/464] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:30.077793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d253c-8034-4662-a2da-49f880310ca9 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:30.112481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07805301-80ec-471f-a114-e406c5ea46cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:30.113645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805301-80ec-471f-a114-e406c5ea46cb None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.113645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805301-80ec-471f-a114-e406c5ea46cb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.113884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805301-80ec-471f-a114-e406c5ea46cb None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.114455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07805301-80ec-471f-a114-e406c5ea46cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:30.114767 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07805301-80ec-471f-a114-e406c5ea46cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:30.116217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07805301-80ec-471f-a114-e406c5ea46cb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:30.129540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 233/465] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:30.130707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb503c-75f2-4054-ae9e-65e71707c98a None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.131008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb503c-75f2-4054-ae9e-65e71707c98a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.131289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb503c-75f2-4054-ae9e-65e71707c98a None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.133859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 234/466] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:30.133859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb503c-75f2-4054-ae9e-65e71707c98a None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:30.160970 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:30.191646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d253c-8034-4662-a2da-49f880310ca9 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:30.227221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc6923-3096-457d-82c6-97b2a2bdfc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:30.227891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc6923-3096-457d-82c6-97b2a2bdfc5a None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.228177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc6923-3096-457d-82c6-97b2a2bdfc5a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.228458 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc6923-3096-457d-82c6-97b2a2bdfc5a None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.229689 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc6923-3096-457d-82c6-97b2a2bdfc5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:30.231167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc6923-3096-457d-82c6-97b2a2bdfc5a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:30.248752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb503c-75f2-4054-ae9e-65e71707c98a None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:30.265842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 233/467] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:36:30 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:36:30.265842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc6923-3096-457d-82c6-97b2a2bdfc5a None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:30.299310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3eed9-bf55-4ec7-9865-22eb19568884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:30.300120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3eed9-bf55-4ec7-9865-22eb19568884 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.300403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3eed9-bf55-4ec7-9865-22eb19568884 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.300683 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3eed9-bf55-4ec7-9865-22eb19568884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.313789 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3eed9-bf55-4ec7-9865-22eb19568884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:30.315306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3eed9-bf55-4ec7-9865-22eb19568884 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-eef3eed9-bf55-4ec7-9865-22eb19568884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:30.335150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:30.336817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:30.337716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:30.337716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:30.337716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:30.337716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:30.337716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 235/468] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:30.338022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1221b-a76b-4033-ad3c-43256c54824e None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.338491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1221b-a76b-4033-ad3c-43256c54824e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.338628 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1221b-a76b-4033-ad3c-43256c54824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.346869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:30.362843 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-15d1221b-a76b-4033-ad3c-43256c54824e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:30.364170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-15d1221b-a76b-4033-ad3c-43256c54824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:30.413883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc6923-3096-457d-82c6-97b2a2bdfc5a None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:30.443042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 236/469] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:30.443994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1221b-a76b-4033-ad3c-43256c54824e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:30.469646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:30.482533 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84460d6f-e568-4d62-bd73-ec16dd2eb2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:30.483268 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460d6f-e568-4d62-bd73-ec16dd2eb2bd None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.483559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460d6f-e568-4d62-bd73-ec16dd2eb2bd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.483846 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460d6f-e568-4d62-bd73-ec16dd2eb2bd None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.485234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84460d6f-e568-4d62-bd73-ec16dd2eb2bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:30.487184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84460d6f-e568-4d62-bd73-ec16dd2eb2bd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:30.518798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 234/470] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:36:30 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:36:30.521431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84460d6f-e568-4d62-bd73-ec16dd2eb2bd None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:30.596704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1221b-a76b-4033-ad3c-43256c54824e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:30.644777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:30.652279 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:30.653389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.653892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.654479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.655343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:30.655766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:30.657447 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:30.673555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 237/471] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:30.676408 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84460d6f-e568-4d62-bd73-ec16dd2eb2bd None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:30.679014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:30.720178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:30.720992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.721277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.721688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.734862 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:30.736452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:30.755710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:30.756677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:30.757545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:30.757545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:30.757545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:30.757545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:30.761830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 235/472] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:30.763113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:30.803725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d8707-546b-41e8-86a1-5e484f0a84df None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:30.810839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:30.853201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6443f0-c60a-48a5-a2ef-ff73a144c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:30.853916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6443f0-c60a-48a5-a2ef-ff73a144c5b1 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.854246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6443f0-c60a-48a5-a2ef-ff73a144c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.854530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6443f0-c60a-48a5-a2ef-ff73a144c5b1 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.855714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6443f0-c60a-48a5-a2ef-ff73a144c5b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:30.857544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6443f0-c60a-48a5-a2ef-ff73a144c5b1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:30.893420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 238/473] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:36:30 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:36:30.895613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aa9fa-dd53-4f78-95cc-e848f31361d1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:30.897536 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135987f-a4be-466a-a200-70a59448c752 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.899046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135987f-a4be-466a-a200-70a59448c752 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.899342 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135987f-a4be-466a-a200-70a59448c752 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.904515 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 239/474] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:30.918445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e47d5d-57f3-43fa-b1dd-2b8e2476f1c8 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.918759 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e47d5d-57f3-43fa-b1dd-2b8e2476f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.919005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e47d5d-57f3-43fa-b1dd-2b8e2476f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.945986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-13e47d5d-57f3-43fa-b1dd-2b8e2476f1c8 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:30.947228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-13e47d5d-57f3-43fa-b1dd-2b8e2476f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:30.969029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:30.969711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:30.970058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:30.970338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:30.972155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:30.972474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:30.973944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:30.999127 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 236/475] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:31.009170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:31.052968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:31.104175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 240/476] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:31.129236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e47d5d-57f3-43fa-b1dd-2b8e2476f1c8 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:31.186948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:31.191242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ec51-79fc-4749-b444-88107d2f591c None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:31.233936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0d6e-a972-4e10-8193-31ecb42890c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:31.234860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0d6e-a972-4e10-8193-31ecb42890c3 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:31.235293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0d6e-a972-4e10-8193-31ecb42890c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:31.235716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0d6e-a972-4e10-8193-31ecb42890c3 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:31.236690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f0d6e-a972-4e10-8193-31ecb42890c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:31.238322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f0d6e-a972-4e10-8193-31ecb42890c3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:31.249343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e47d5d-57f3-43fa-b1dd-2b8e2476f1c8 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:31.269434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 237/477] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:36:31 2022] POST /identity/v3/users => generated 249 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:36:31.295664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:31.296626 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:31.297060 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:31.297533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:31.298422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:31.299904 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:31.306956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.sql.core [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:36:31.306956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 13:36:31.306956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [parameters: {'id': '9a30e8219bb94c24b9458a1c21b79a8c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 13:36:31.306956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86847) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application conn.query(q) May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application result.read() May 25 13:36:31.324859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return ref.to_dict() May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:36:31.325864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application next(self.gen) May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application yield resource May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application next(self.gen) May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.session.rollback() May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.force_reraise() May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise self.value May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application session.commit() May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 13:36:31.326844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._prepare_impl() May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.session.flush() May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._flush(objects) May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application compat.raise_( May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application flush_context.execute() May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rec.execute(self) May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 13:36:31.327738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:36:31.328695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application conn.query(q) May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application result.read() May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:36:31.329550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [parameters: {'id': '9a30e8219bb94c24b9458a1c21b79a8c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:31.332138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 13:36:31.338937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:31.340945 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 241/478] 10.222.0.13 () {60 vars in 1131 bytes} [Wed May 25 13:36:31 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:31.344434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0d6e-a972-4e10-8193-31ecb42890c3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:31.476554 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0d6e-a972-4e10-8193-31ecb42890c3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:31.526675 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964349f-ada0-4220-8183-adf1ba2519ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:31.527836 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964349f-ada0-4220-8183-adf1ba2519ea None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:31.528321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964349f-ada0-4220-8183-adf1ba2519ea None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:31.528808 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964349f-ada0-4220-8183-adf1ba2519ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:31.540736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964349f-ada0-4220-8183-adf1ba2519ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-a964349f-ada0-4220-8183-adf1ba2519ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:31.550025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:31.550996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 13:36:31.551804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:31.554590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 238/479] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:36:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:31.564407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:31.618947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:31.685493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd476d-b2ba-4470-b071-3bf251090f5a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:31.721990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86f0b3-81b8-4b27-b7b6-cf810713403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:31.722694 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f0b3-81b8-4b27-b7b6-cf810713403a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:31.722985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f0b3-81b8-4b27-b7b6-cf810713403a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:31.723272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f0b3-81b8-4b27-b7b6-cf810713403a None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:31.724045 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86f0b3-81b8-4b27-b7b6-cf810713403a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:31.724365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86f0b3-81b8-4b27-b7b6-cf810713403a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:31.725829 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86f0b3-81b8-4b27-b7b6-cf810713403a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:31.735920 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 242/480] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:33.173639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35228c2-5706-410f-8856-f61db9bdca0a None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.174506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35228c2-5706-410f-8856-f61db9bdca0a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.174941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35228c2-5706-410f-8856-f61db9bdca0a None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.176786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 239/481] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:33.182095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f90fa-f5bb-44ef-b9e3-018c231e72cf None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.182928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f90fa-f5bb-44ef-b9e3-018c231e72cf None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.183361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f90fa-f5bb-44ef-b9e3-018c231e72cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.206860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-7c4f90fa-f5bb-44ef-b9e3-018c231e72cf None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:33.208310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-7c4f90fa-f5bb-44ef-b9e3-018c231e72cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:33.299955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 243/482] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:33.335264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35228c2-5706-410f-8856-f61db9bdca0a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:33.355037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:33.387665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3af84-ed0b-4944-8ab2-7a17f49d01b6 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.388231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3af84-ed0b-4944-8ab2-7a17f49d01b6 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.388662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3af84-ed0b-4944-8ab2-7a17f49d01b6 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.390228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 244/483] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:33.395725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc3f6-82da-4130-a2b1-27031e1b40e5 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.396176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc3f6-82da-4130-a2b1-27031e1b40e5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.396569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc3f6-82da-4130-a2b1-27031e1b40e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.424310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-983fc3f6-82da-4130-a2b1-27031e1b40e5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:33.425584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-983fc3f6-82da-4130-a2b1-27031e1b40e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:33.461605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35228c2-5706-410f-8856-f61db9bdca0a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:33.474162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:33.499854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b94d-0850-4eb9-9135-5967b7678e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:33.500933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b94d-0850-4eb9-9135-5967b7678e66 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.501370 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b94d-0850-4eb9-9135-5967b7678e66 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.501941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b94d-0850-4eb9-9135-5967b7678e66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.513422 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3b94d-0850-4eb9-9135-5967b7678e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:33.518095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 245/484] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-39d3b94d-0850-4eb9-9135-5967b7678e66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:33.522269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:33.523153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:33.523967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:33.527220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 240/485] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:33.533778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fc3f6-82da-4130-a2b1-27031e1b40e5 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:33.537335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b94d-0850-4eb9-9135-5967b7678e66 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:33.646103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:33.668057 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fc3f6-82da-4130-a2b1-27031e1b40e5 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:33.690626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b94d-0850-4eb9-9135-5967b7678e66 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:33.742307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:33.744232 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.746337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.746837 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.747809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:33.749402 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:33.751061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:33.764263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2fbb5-0e4a-419f-9587-f94487105422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:33.766456 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2fbb5-0e4a-419f-9587-f94487105422 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.767123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2fbb5-0e4a-419f-9587-f94487105422 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.768668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2fbb5-0e4a-419f-9587-f94487105422 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.770355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 246/486] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:33.775815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:33.810803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2fbb5-0e4a-419f-9587-f94487105422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-3bb2fbb5-0e4a-419f-9587-f94487105422 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:33.819058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:33.820011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:33.820822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:33.826814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 241/487] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:33.828493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:33.832562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2fbb5-0e4a-419f-9587-f94487105422 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:33.912182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7c7e-0f86-47ca-a0a6-2d20b5383665 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:33.945809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197dfeb-6103-4551-be08-5a431579bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:33.946600 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197dfeb-6103-4551-be08-5a431579bd36 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.946824 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197dfeb-6103-4551-be08-5a431579bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.947111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197dfeb-6103-4551-be08-5a431579bd36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.952972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2fbb5-0e4a-419f-9587-f94487105422 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:33.959326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197dfeb-6103-4551-be08-5a431579bd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:33.961086 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197dfeb-6103-4551-be08-5a431579bd36 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-f197dfeb-6103-4551-be08-5a431579bd36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:33.979395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:33.980418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:33.981310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:33.981310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:33.981310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:33.981310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:33.981310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 247/488] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:33.982356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeccd9a-1186-41e5-a5d4-63f7a1a6060d None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:33.982714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeccd9a-1186-41e5-a5d4-63f7a1a6060d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:33.983003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeccd9a-1186-41e5-a5d4-63f7a1a6060d None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:33.988480 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 248/489] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:33.989299 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeccd9a-1186-41e5-a5d4-63f7a1a6060d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.001683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d239ef-5405-4451-8347-000c2f3f2b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.002412 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d239ef-5405-4451-8347-000c2f3f2b28 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.002699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d239ef-5405-4451-8347-000c2f3f2b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.002981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d239ef-5405-4451-8347-000c2f3f2b28 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.003770 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d239ef-5405-4451-8347-000c2f3f2b28 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:34.004082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d239ef-5405-4451-8347-000c2f3f2b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:34.005535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d239ef-5405-4451-8347-000c2f3f2b28 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:34.008449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:34.020203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 242/490] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:34.023047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4d17-c91b-4966-8810-e2bd3656affb None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.023914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4d17-c91b-4966-8810-e2bd3656affb None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.024401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f4d17-c91b-4966-8810-e2bd3656affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.048208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-8f2f4d17-c91b-4966-8810-e2bd3656affb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:34.050784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-8f2f4d17-c91b-4966-8810-e2bd3656affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:34.114602 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:34.133671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 243/491] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:34.134810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f4d17-c91b-4966-8810-e2bd3656affb None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.145170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeccd9a-1186-41e5-a5d4-63f7a1a6060d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.184314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.185909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.186493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.186965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.187907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:34.188410 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:34.190240 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:34.203774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 249/492] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:34.204387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.246903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f4d17-c91b-4966-8810-e2bd3656affb None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.275012 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:34.286058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcc670-0b30-4d23-a179-db440137cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.286907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcc670-0b30-4d23-a179-db440137cf3e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.287195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcc670-0b30-4d23-a179-db440137cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.287594 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcc670-0b30-4d23-a179-db440137cf3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.298651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcc670-0b30-4d23-a179-db440137cf3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:34.300112 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcc670-0b30-4d23-a179-db440137cf3e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:34.310534 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc71087-5bb1-433b-b818-df6cc1438830 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-40dcc670-0b30-4d23-a179-db440137cf3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:34.319587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:34.320463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:34.321320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:34.321320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:34.321320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:34.321320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:34.321320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 244/493] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:34.322265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4e63-585d-4849-b830-c9687c442aa2 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.322668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4e63-585d-4849-b830-c9687c442aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.322906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4e63-585d-4849-b830-c9687c442aa2 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.324774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 245/494] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:34.326560 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4e63-585d-4849-b830-c9687c442aa2 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.355134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15355beb-dcd0-464b-b6a3-591715eb14b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.355939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15355beb-dcd0-464b-b6a3-591715eb14b2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.356228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15355beb-dcd0-464b-b6a3-591715eb14b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.356515 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15355beb-dcd0-464b-b6a3-591715eb14b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.364169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:34.368941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15355beb-dcd0-464b-b6a3-591715eb14b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-15355beb-dcd0-464b-b6a3-591715eb14b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:34.377911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:34.378923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:34.379746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 250/495] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:34.380678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55feb-eeac-4bcf-9d13-a4e2a95bcc05 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.380973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55feb-eeac-4bcf-9d13-a4e2a95bcc05 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.381255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55feb-eeac-4bcf-9d13-a4e2a95bcc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.398476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-70a55feb-eeac-4bcf-9d13-a4e2a95bcc05 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:34.399672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-70a55feb-eeac-4bcf-9d13-a4e2a95bcc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:34.446045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4e63-585d-4849-b830-c9687c442aa2 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.472976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 251/496] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:34.474126 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a55feb-eeac-4bcf-9d13-a4e2a95bcc05 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.495653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.496856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.497155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.497433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.507443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:34.509623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:34.531010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:34.531972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:36:34.532893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:34.535390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 246/497] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:34.536250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.580002 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:34.584970 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a55feb-eeac-4bcf-9d13-a4e2a95bcc05 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.616540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:34.626645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.627347 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.627638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.627921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.628677 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:34.628987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:34.630488 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:34.648838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 252/498] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:34.648838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.657061 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb275-36e5-4f2f-9fc6-8e18d29486e4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.722020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.723232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.723691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.724350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.725998 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:34.726567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:34.729915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:34.745562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 247/499] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:34.746437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.759770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85468a-982c-4f8b-b347-153cb9ec7cf2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.803599 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9de70-8bb9-4f3a-a977-cae11b862f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.804492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9de70-8bb9-4f3a-a977-cae11b862f8f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.804850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9de70-8bb9-4f3a-a977-cae11b862f8f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.805203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9de70-8bb9-4f3a-a977-cae11b862f8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.817468 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9de70-8bb9-4f3a-a977-cae11b862f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-6ff9de70-8bb9-4f3a-a977-cae11b862f8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:34.825321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:34.826439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 253/500] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:34.827456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9de70-8bb9-4f3a-a977-cae11b862f8f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.854965 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:34.858244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7ab3-6436-4c73-bd6b-88fec7f6bda0 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.878120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:34.894532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.895678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.896200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.896712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.898400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:34.898977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:34.902283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:34.928610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9de70-8bb9-4f3a-a977-cae11b862f8f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:34.950178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 248/501] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:34.951024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:34.965946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b961a-4daf-4ae5-8738-f292d005ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:34.966743 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b961a-4daf-4ae5-8738-f292d005ff82 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.967029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b961a-4daf-4ae5-8738-f292d005ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.967305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b961a-4daf-4ae5-8738-f292d005ff82 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.974898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b961a-4daf-4ae5-8738-f292d005ff82 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:34.976302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b961a-4daf-4ae5-8738-f292d005ff82 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-f78b961a-4daf-4ae5-8738-f292d005ff82 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:34.992245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:34.993306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:34.994394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 254/502] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:34.995003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901c6b-299c-4966-ba32-0bef14f7b577 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:34.995230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901c6b-299c-4966-ba32-0bef14f7b577 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:34.995463 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901c6b-299c-4966-ba32-0bef14f7b577 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:34.996878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 255/503] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:34.998706 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901c6b-299c-4966-ba32-0bef14f7b577 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.051457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159987-98ec-4fab-8d03-d0e7273839c4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.084981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.086059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.086350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.086629 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.097250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.098904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.110404 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901c6b-299c-4966-ba32-0bef14f7b577 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:35.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:35.117702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:35.118618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:35.118618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:35.118618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:35.118618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:35.118618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 249/504] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:35.118893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.119831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:35.135841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:35.148108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.148785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.149068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.149349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.150129 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:35.150443 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.152326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.160439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 256/505] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:35.161225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.222430 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec132-701c-4fb3-a53c-6814820f6e83 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.256209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54044955-c4c7-4396-b808-b27ffecf319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.256822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54044955-c4c7-4396-b808-b27ffecf319f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.257055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54044955-c4c7-4396-b808-b27ffecf319f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.257343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54044955-c4c7-4396-b808-b27ffecf319f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.260790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c76d-616c-4c3c-8e6e-edbb6abbbefb None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.295272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7e75e-66e9-49ce-bb81-dcfc1ca854e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.295942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e75e-66e9-49ce-bb81-dcfc1ca854e0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.296227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e75e-66e9-49ce-bb81-dcfc1ca854e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.296506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e75e-66e9-49ce-bb81-dcfc1ca854e0 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.297343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7e75e-66e9-49ce-bb81-dcfc1ca854e0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:35.297661 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7e75e-66e9-49ce-bb81-dcfc1ca854e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.299138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7e75e-66e9-49ce-bb81-dcfc1ca854e0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.325573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54044955-c4c7-4396-b808-b27ffecf319f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.327067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54044955-c4c7-4396-b808-b27ffecf319f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.335810 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 257/506] 10.222.0.13 () {56 vars in 1137 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:35.337086 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be088a-09fd-4216-bc5a-9434eb803e98 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.337475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be088a-09fd-4216-bc5a-9434eb803e98 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.337861 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be088a-09fd-4216-bc5a-9434eb803e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.341442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:35.355107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-10be088a-09fd-4216-bc5a-9434eb803e98 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:35.356303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-10be088a-09fd-4216-bc5a-9434eb803e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:35.378503 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:35.431384 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 258/507] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:35.432257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be088a-09fd-4216-bc5a-9434eb803e98 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.457111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 250/508] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:35.457111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54044955-c4c7-4396-b808-b27ffecf319f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.545917 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be088a-09fd-4216-bc5a-9434eb803e98 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.558558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54044955-c4c7-4396-b808-b27ffecf319f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.569029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:35.581620 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.582312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.582597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.582875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.583591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:35.583933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.585326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.597288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 259/509] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:35.598234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.599120 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.599909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.600194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.600475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.610448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.611893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.618047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:35.629474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:35.630580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:35.631823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:35.631823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:35.631823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:35.631823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:35.631823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 251/510] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:35.634479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.710297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafda6c-3eee-4cdb-bcda-712a639eee91 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.742025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064d94-4ecb-4e4f-885e-a519a2582f56 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.750271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc86afb-1cac-458f-aa30-fe301f790af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.750921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86afb-1cac-458f-aa30-fe301f790af4 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.751207 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86afb-1cac-458f-aa30-fe301f790af4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.751486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86afb-1cac-458f-aa30-fe301f790af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.775924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.776700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.776982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.777260 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.789943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.791425 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:35.809618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:35.810526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:35.811418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:35.811418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:35.811418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:35.811418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:35.811418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 252/511] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:35.811688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.827654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc86afb-1cac-458f-aa30-fe301f790af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.828546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:35.829154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc86afb-1cac-458f-aa30-fe301f790af4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.848086 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:35.916232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37abf00-c711-46c9-8d01-c72414b40bab None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:35.929058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 260/512] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:35.929942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc86afb-1cac-458f-aa30-fe301f790af4 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:35.951904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:35.952692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:35.952976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:35.953250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:35.963597 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:35.965094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:35.982771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:35.983907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:35.984820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:35.984820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:35.984820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:35.984820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:35.984820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 253/513] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:35.985087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.032202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc86afb-1cac-458f-aa30-fe301f790af4 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.055361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:36.056962 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:36.077682 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.078735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.079154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.079755 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] PATH_INFO: `/v3/users/glance` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.088171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.089650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.094332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7de6b-82b1-4115-86d9-b4322d8819aa None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:36.103949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:36.105366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 261/514] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:36.106845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.137991 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.139101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.139586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.139890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.140967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:36.141287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.142691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.153959 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 254/515] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:36.154767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.205896 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc9b7-ed8d-42be-a79f-eb695ebaa2de None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.239851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.240750 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.241186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.241457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.242208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:36.242522 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.243921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.255451 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 262/516] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:36.255591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f560b-798f-4dba-88dd-d92c16638df5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.256247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.280706 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:36.290020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.290819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.291116 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.291397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.295858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:36.302645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.304103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:36.321410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:36.322540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:36.323643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:36.323643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:36.323643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:36.323643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:36.323643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 255/517] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:36.323643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.364253 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d44ea3-bf4c-44bb-916f-fccbac4f2725 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.398869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.399534 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.399819 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.400099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.400813 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:36.401619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.403036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.414569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 263/518] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:36.415364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.433102 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e35b-8351-4889-add8-61dfd57e853e None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.466540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.467208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.467499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.467785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.468633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:36.468948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.470429 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.488374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 256/519] 10.222.0.13 () {56 vars in 1137 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:36.489020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.518631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:36.523341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13cf34-b04b-459e-b36b-0aa38ae1c806 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.526903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:36.558257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.559058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.559347 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.559627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.566842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.568313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:36.582756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:36.583696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 264/520] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:36.584857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.595652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521c4cd-5875-4f2f-9b0a-f2c45a4f5dd6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.629276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0e92d-ca00-4e46-85a9-a70a96e1fd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.629899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0e92d-ca00-4e46-85a9-a70a96e1fd1e None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.630189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0e92d-ca00-4e46-85a9-a70a96e1fd1e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.630470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0e92d-ca00-4e46-85a9-a70a96e1fd1e None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.631454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0e92d-ca00-4e46-85a9-a70a96e1fd1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.632613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0e92d-ca00-4e46-85a9-a70a96e1fd1e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.652655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 257/521] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:36:36 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:36:36.653484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0e92d-ca00-4e46-85a9-a70a96e1fd1e None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.702894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eba93d-4fb9-4d78-904b-54ca942de8f0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.742854 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.743592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.743907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.744156 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.745394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:36.745699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.747184 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.761561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 265/522] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:36.762312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.770775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:36.784916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0e92d-ca00-4e46-85a9-a70a96e1fd1e None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.789127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:36.826790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.827725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.828011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.828292 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.837836 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:36.840059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:36.857262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:36.858229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:36.859095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 258/523] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:36.859637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:36.893053 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2de0c-879f-4357-84bc-34a892c5ff7c None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:36.929223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a68f46-4fec-4070-b826-381ecda9e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:36.930014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68f46-4fec-4070-b826-381ecda9e5df None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:36.930300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68f46-4fec-4070-b826-381ecda9e5df None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:36.930606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68f46-4fec-4070-b826-381ecda9e5df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:36.971452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbd57-7de5-4b8b-b535-f7517ddec9ee None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.003042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a68f46-4fec-4070-b826-381ecda9e5df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.004528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a68f46-4fec-4070-b826-381ecda9e5df None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.007143 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.007890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.008250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.008602 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.009511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:37.009947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.011988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.024172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:37.031277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 259/524] 10.222.0.13 () {56 vars in 1139 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:37.036323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.048492 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:37.116762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 266/525] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:37.117921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a68f46-4fec-4070-b826-381ecda9e5df None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.145494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754f8d-176e-4700-b650-0baf1d9883e9 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.182644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.183446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.183732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.184009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.191218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.192672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:37.207317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:37.208234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:37.209193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 260/526] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:37.209683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.234544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a68f46-4fec-4070-b826-381ecda9e5df None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.254377 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:37.272657 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.273309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.273592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.273936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.274715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:37.275026 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.276498 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.282742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:37.294805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 267/527] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:37.295476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.321606 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f7ded-44b6-43cf-ba24-64209c227397 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.357347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62f5a-ca75-419b-b087-9e01eff9c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.358019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62f5a-ca75-419b-b087-9e01eff9c97f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.358310 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62f5a-ca75-419b-b087-9e01eff9c97f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.358595 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62f5a-ca75-419b-b087-9e01eff9c97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.401296 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2381acc-0b0a-4300-9b1f-7844dbcef4ed None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.427593 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f62f5a-ca75-419b-b087-9e01eff9c97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.429049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f62f5a-ca75-419b-b087-9e01eff9c97f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.436697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.437501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.437809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.438087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.449268 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.451200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:37.469076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:37.470069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:37.470948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:37.470948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:37.470948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:37.470948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:37.470948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 268/528] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:37.471654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.503329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:37.503544 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:37.543104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 261/529] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:37.543104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62f5a-ca75-419b-b087-9e01eff9c97f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.584146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada66a6-852e-479b-8b32-4c68c47c069e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.618772 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.620393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.620393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.620670 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.621441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:37.622072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.623641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.643343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 269/530] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:37.643343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.651376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62f5a-ca75-419b-b087-9e01eff9c97f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.687595 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.688238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.688524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.688799 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.689768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:37.690087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.691545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.697144 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 262/531] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/role_assignments?user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:37.697826 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.738740 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:37.765581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:37.778097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63433a92-4547-43f2-ac6e-cf4546f2e6f1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.834313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.834673 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773a94-a002-4f71-875f-8d9654229208 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:37.835247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.835889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.836289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.837153 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:37.837691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.840720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.857845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 270/532] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:37.858812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:37.876809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:37.878139 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:37.878770 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:37.879273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:37.892428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:37.894317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:37.916742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:37.917665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:37.918855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:37.918855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:37.918855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:37.918855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:37.918855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 263/533] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:37.919367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:38.000867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56d778-fcaa-4ec7-8610-71f67bafb5c0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:38.031356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c91fa5-ef97-49b8-b159-978a118e8037 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:38.034144 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:38.046098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:38.047102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:38.047456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:38.047806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:38.049226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=5c27e8bab1f3424aadd7ca66a1e2756f) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:38.049872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:38.051667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:38.059700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 271/534] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/role_assignments?user.id=5c27e8bab1f3424aadd7ca66a1e2756f&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:38.060885 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:38.073324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:38.074483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:38.075017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:38.075514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:38.090097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:38.092369 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:38.094362 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:38.136542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:38.137486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:38.138389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:38.138389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:38.138389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:38.138389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:38.138389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:38.138389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:38.138389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:38.138389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:38.140985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 264/535] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:38.146892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:38.192551 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dca63-7378-44e6-b851-97975cc2613b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:38.248056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:38.248816 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:38.249104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:38.249387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:38.250927 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:38.251245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:38.252688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:38.270010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 272/536] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:38.279624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:38.352267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f072b30-6fe9-4ffa-9368-99f5eb7b1c11 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:38.397780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:38.419937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:38.420950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:38.421487 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:38.422310 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:38.423328 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:38.423838 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:38.425523 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:38.449360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d2c32-97e8-499f-b0a3-442a7cd5bc41 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:38.467816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 265/537] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:38.475821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:38.490245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:38.508918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:38.510364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:38.510860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:38.511340 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:38.526564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:38.528424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:38.559818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:38.560765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:38.561642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:38.561642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:38.561642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:38.561642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:38.561642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:38.561642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:38.561642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:38.561642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:38.566260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 273/538] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:38.571531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:38.619367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd3a74-6fce-458c-8920-0b7eca66c4dc None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:38.658173 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:38.659263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:38.659783 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:38.660263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:38.661295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=7fc89b93f03e453da2780d75216e0566) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:38.661842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:38.664069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:38.671974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 266/539] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:38 2022] GET /identity/v3/role_assignments?user.id=7fc89b93f03e453da2780d75216e0566&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:38.733119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63d5f-302e-4679-84bb-3f1cac8f7ce1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:38.804191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bf4d1-1456-414b-9cb2-cc8b830339b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:38.804948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bf4d1-1456-414b-9cb2-cc8b830339b2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:38.805236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bf4d1-1456-414b-9cb2-cc8b830339b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:38.805511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bf4d1-1456-414b-9cb2-cc8b830339b2 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:38.806379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bf4d1-1456-414b-9cb2-cc8b830339b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:38.806693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bf4d1-1456-414b-9cb2-cc8b830339b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:38.808264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bf4d1-1456-414b-9cb2-cc8b830339b2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:38.810205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:38.828997 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 274/540] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:38.834743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:38.942644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:38.976067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bf8c5-4d7e-4882-aa17-5a1b832865ee None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:39.019633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031b7c5-f5f9-4911-b9e0-02da676370a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:39.020207 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031b7c5-f5f9-4911-b9e0-02da676370a4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:39.020492 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031b7c5-f5f9-4911-b9e0-02da676370a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:39.020767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031b7c5-f5f9-4911-b9e0-02da676370a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:39.021601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031b7c5-f5f9-4911-b9e0-02da676370a4 None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=5d7bc855c20b431b9aabaee20101b79c) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:39.021940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031b7c5-f5f9-4911-b9e0-02da676370a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:39.023368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031b7c5-f5f9-4911-b9e0-02da676370a4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:39.034024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 267/541] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:38 2022] GET /identity/v3/role_assignments?user.id=5d7bc855c20b431b9aabaee20101b79c&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:39.040327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc889f9-f1cf-4d2c-b045-1d8aa2a61519 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:39.040619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc889f9-f1cf-4d2c-b045-1d8aa2a61519 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:39.040894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc889f9-f1cf-4d2c-b045-1d8aa2a61519 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:39.043231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 275/542] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:39.050642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292fd5-47c9-46f7-a559-8b417529d6ae None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:39.051243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292fd5-47c9-46f7-a559-8b417529d6ae None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:39.051703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292fd5-47c9-46f7-a559-8b417529d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:39.078712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b8292fd5-47c9-46f7-a559-8b417529d6ae None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:39.080457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b8292fd5-47c9-46f7-a559-8b417529d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:39.179674 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 268/543] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:39.222162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc889f9-f1cf-4d2c-b045-1d8aa2a61519 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:39.358724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc889f9-f1cf-4d2c-b045-1d8aa2a61519 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:39.404432 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dee2e-9c0a-4eb9-9a76-e3d1bc8295b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:39.405248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dee2e-9c0a-4eb9-9a76-e3d1bc8295b9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:39.405539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dee2e-9c0a-4eb9-9a76-e3d1bc8295b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:39.405850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dee2e-9c0a-4eb9-9a76-e3d1bc8295b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:39.425805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dee2e-9c0a-4eb9-9a76-e3d1bc8295b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-db1dee2e-9c0a-4eb9-9a76-e3d1bc8295b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:39.434290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:39.435211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:39.436466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 276/544] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:39.446870 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8292fd5-47c9-46f7-a559-8b417529d6ae None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:39.559916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:39.607651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8292fd5-47c9-46f7-a559-8b417529d6ae None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:39.657444 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:39.658068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:39.658355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:39.658636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:39.659468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:39.659788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:39.661170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:39.670173 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 269/545] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:39.675797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dee2e-9c0a-4eb9-9a76-e3d1bc8295b9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:39.798087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:39.877338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dee2e-9c0a-4eb9-9a76-e3d1bc8295b9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:39.922936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:39.924067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:39.924581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:39.925054 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:39.940897 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:39.942677 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:39.967246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:39.968162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:39.969005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:39.969005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:39.969005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:39.969005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:39.971390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 277/546] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:39.978847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:40.125529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824d731-fe8d-4096-97f5-4486d4734564 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:40.152939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:40.162127 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02052d-b40b-4b75-9f73-c3ba73460a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:40.162793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02052d-b40b-4b75-9f73-c3ba73460a07 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:40.163084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02052d-b40b-4b75-9f73-c3ba73460a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:40.163464 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02052d-b40b-4b75-9f73-c3ba73460a07 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:40.164094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02052d-b40b-4b75-9f73-c3ba73460a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:40.164778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02052d-b40b-4b75-9f73-c3ba73460a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:40.166297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02052d-b40b-4b75-9f73-c3ba73460a07 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:40.179572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 270/547] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:40.184618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:40.350685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3045cd-adf7-4452-8543-87ddca5fbda9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:40.360400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:40.395957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:40.396772 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:40.397063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:40.397352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:40.407432 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:40.408923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:40.422243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe38c-0fbe-4471-a235-0e52a6f52db0 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:40.422578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe38c-0fbe-4471-a235-0e52a6f52db0 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:40.422867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe38c-0fbe-4471-a235-0e52a6f52db0 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:40.424482 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 271/548] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:40.429459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a439-c1a0-48db-95e5-1c42cec3ac07 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:40.429831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a439-c1a0-48db-95e5-1c42cec3ac07 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:40.430024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:40.431390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:36:40.433015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:40.433549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a439-c1a0-48db-95e5-1c42cec3ac07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:40.433629 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 278/549] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:36:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:40.437157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:40.470889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9bd8a439-c1a0-48db-95e5-1c42cec3ac07 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:40.472103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9bd8a439-c1a0-48db-95e5-1c42cec3ac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:40.560375 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8de2c2-88ae-4918-bd2f-25162b31fe9d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:40.587817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 272/550] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:40.596776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:40.597458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:40.597760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:40.598090 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:40.598910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:40.599230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:40.600684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:40.619008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 279/551] 10.222.0.13 () {56 vars in 1135 bytes} [Wed May 25 13:36:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:40.620025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a439-c1a0-48db-95e5-1c42cec3ac07 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:40.628338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:40.674134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:40.820259 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a439-c1a0-48db-95e5-1c42cec3ac07 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:40.831399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd7cb-5290-477b-8aeb-a55601772e23 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:40.878562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:40.884682 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9deec-e690-4e5b-8c6a-dd9a12a0511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:40.887945 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9deec-e690-4e5b-8c6a-dd9a12a0511c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:40.889777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9deec-e690-4e5b-8c6a-dd9a12a0511c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:40.889777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9deec-e690-4e5b-8c6a-dd9a12a0511c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:40.901917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e87e4-f3fd-4fc5-80a4-c81ada085895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:40.902698 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e87e4-f3fd-4fc5-80a4-c81ada085895 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:40.902985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e87e4-f3fd-4fc5-80a4-c81ada085895 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:40.903265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e87e4-f3fd-4fc5-80a4-c81ada085895 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:40.918753 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e87e4-f3fd-4fc5-80a4-c81ada085895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-019e87e4-f3fd-4fc5-80a4-c81ada085895 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:40.926854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:40.927975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:40.928824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 273/552] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:40.930096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d151eb-96ea-4480-a48f-10f3a2d66fce None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:40.930096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d151eb-96ea-4480-a48f-10f3a2d66fce None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:40.930255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d151eb-96ea-4480-a48f-10f3a2d66fce None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:40.936175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 274/553] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:40.936175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d151eb-96ea-4480-a48f-10f3a2d66fce None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:40.997341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9deec-e690-4e5b-8c6a-dd9a12a0511c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:41.000211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9deec-e690-4e5b-8c6a-dd9a12a0511c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:41.038168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:41.059373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d151eb-96ea-4480-a48f-10f3a2d66fce None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.107507 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6a062-6901-4e97-a973-f40e748cfd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.108797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a062-6901-4e97-a973-f40e748cfd9d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.109325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a062-6901-4e97-a973-f40e748cfd9d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.110032 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a062-6901-4e97-a973-f40e748cfd9d None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.111474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a062-6901-4e97-a973-f40e748cfd9d None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:41.112062 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a062-6901-4e97-a973-f40e748cfd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:41.114406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a062-6901-4e97-a973-f40e748cfd9d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:41.127151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 275/554] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:41.132185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 280/555] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 13:36:41.132320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657522b-e53f-4f93-a732-3808d6a58375 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.132320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657522b-e53f-4f93-a732-3808d6a58375 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.132487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9deec-e690-4e5b-8c6a-dd9a12a0511c None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.132907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657522b-e53f-4f93-a732-3808d6a58375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.151588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-c657522b-e53f-4f93-a732-3808d6a58375 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:41.152779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-c657522b-e53f-4f93-a732-3808d6a58375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:41.184886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:41.238764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 276/556] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:41.239636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657522b-e53f-4f93-a732-3808d6a58375 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.261652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9deec-e690-4e5b-8c6a-dd9a12a0511c None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.286994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:41.300732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ade4d3-404b-4ba4-9359-7109436d581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.301532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade4d3-404b-4ba4-9359-7109436d581f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.301848 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade4d3-404b-4ba4-9359-7109436d581f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.302131 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade4d3-404b-4ba4-9359-7109436d581f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.313208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ade4d3-404b-4ba4-9359-7109436d581f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:41.314664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ade4d3-404b-4ba4-9359-7109436d581f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-b2ade4d3-404b-4ba4-9359-7109436d581f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:41.335719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:41.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:41.337591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:41.337591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:41.337591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:41.337591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:41.341883 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 281/557] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:41.343000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c9942-dc74-4631-92d1-57dc5cb0427e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.343299 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c9942-dc74-4631-92d1-57dc5cb0427e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.343586 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c9942-dc74-4631-92d1-57dc5cb0427e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.344922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 282/558] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:41.345573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c9942-dc74-4631-92d1-57dc5cb0427e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.361860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657522b-e53f-4f93-a732-3808d6a58375 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.398360 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.399156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.399507 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.399784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.410038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:41.411493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:41.431353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:41.433378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:41.435136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:41.435136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:41.435136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:41.435136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:41.435136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 277/559] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:41.435136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.459277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c9942-dc74-4631-92d1-57dc5cb0427e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.464109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:41.500778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02cd8a-9c8d-403e-bfd2-d15e93dc9937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.501584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02cd8a-9c8d-403e-bfd2-d15e93dc9937 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.501924 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02cd8a-9c8d-403e-bfd2-d15e93dc9937 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.502205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02cd8a-9c8d-403e-bfd2-d15e93dc9937 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.512806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02cd8a-9c8d-403e-bfd2-d15e93dc9937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-1d02cd8a-9c8d-403e-bfd2-d15e93dc9937 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:41.520478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:41.521437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 283/560] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:41.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c2b1-b44a-479f-958e-9ffd16bae0f5 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.528388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c2b1-b44a-479f-958e-9ffd16bae0f5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.528388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c2b1-b44a-479f-958e-9ffd16bae0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.540764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-9e31c2b1-b44a-479f-958e-9ffd16bae0f5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:41.542501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-9e31c2b1-b44a-479f-958e-9ffd16bae0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:41.556046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc0e0-9980-4161-8902-01d61667f3e2 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.572026 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:41.593800 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.594484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.594766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.595047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.595776 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:41.596087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:41.597482 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:41.609829 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 278/561] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:41.610494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.618238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 284/562] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:41.619093 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31c2b1-b44a-479f-958e-9ffd16bae0f5 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.707062 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:41.727093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e7dc-2de4-4051-9705-6586dc01457f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.731181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31c2b1-b44a-479f-958e-9ffd16bae0f5 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.763257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.763968 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.764260 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.764541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.765295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:41.765612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:41.767166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:41.771153 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.771846 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.772139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.772477 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.773305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:41.773621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:41.775285 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:41.785436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 279/563] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:41.786413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.793007 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 285/564] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:41.794170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.824234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:41.902094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0933f-ed8c-4861-84ec-b1d7c80cc78f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.905343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2051-5d6f-4451-9ba1-37730421bc52 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:41.942543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.943343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.943630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.943906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.944706 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b7593-bfed-4490-b9d2-14f37d3ad360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:41.945523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7593-bfed-4490-b9d2-14f37d3ad360 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:41.945845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7593-bfed-4490-b9d2-14f37d3ad360 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:41.946135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7593-bfed-4490-b9d2-14f37d3ad360 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:41.952096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:41.953584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:41.956479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:41.958034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b7593-bfed-4490-b9d2-14f37d3ad360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-047b7593-bfed-4490-b9d2-14f37d3ad360 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:41.966889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:41.967893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:41.968742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 286/565] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:41.969435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b7593-bfed-4490-b9d2-14f37d3ad360 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:41.970825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:41.971960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:36:41.973619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:41.976818 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 280/566] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:41.977678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.069947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:42.083309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b7593-bfed-4490-b9d2-14f37d3ad360 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.084284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fea3d-5cd4-470f-a47a-19a87f41b543 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.119201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ae53f-8453-4479-80d6-e1dd6390dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.120048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae53f-8453-4479-80d6-e1dd6390dccd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.120329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae53f-8453-4479-80d6-e1dd6390dccd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.120611 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae53f-8453-4479-80d6-e1dd6390dccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.122032 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.122837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.123124 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.123413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.127647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ae53f-8453-4479-80d6-e1dd6390dccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.129141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ae53f-8453-4479-80d6-e1dd6390dccd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.133940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.135904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-ce8ae53f-8453-4479-80d6-e1dd6390dccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:42.144237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:42.145492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 287/567] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668357f-4a0b-405a-bb20-a689078a5628 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.147119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668357f-4a0b-405a-bb20-a689078a5628 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.147733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668357f-4a0b-405a-bb20-a689078a5628 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.153441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 288/568] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:42.153441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668357f-4a0b-405a-bb20-a689078a5628 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:42.156820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:42.157722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:42.160351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:42.160351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:42.160351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:42.160351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:42.160351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 281/569] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:42.160351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.218514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:42.273558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a28a3-ee21-41bf-bcc7-1dd703c56458 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.274475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668357f-4a0b-405a-bb20-a689078a5628 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.309710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5427d6-e354-45eb-acd1-4b987c7bfb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.310414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5427d6-e354-45eb-acd1-4b987c7bfb97 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.310669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.310788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5427d6-e354-45eb-acd1-4b987c7bfb97 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.310968 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5427d6-e354-45eb-acd1-4b987c7bfb97 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.311334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.311617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.311817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5427d6-e354-45eb-acd1-4b987c7bfb97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:42.311916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.312135 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5427d6-e354-45eb-acd1-4b987c7bfb97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.312643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:42.312951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.313598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5427d6-e354-45eb-acd1-4b987c7bfb97 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.314357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.322507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 289/570] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:42.323861 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.337876 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 282/571] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:42.338895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:42.339729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55278-dcc2-4e1a-9f14-0318cd7b8ceb None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.340032 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55278-dcc2-4e1a-9f14-0318cd7b8ceb None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.340318 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55278-dcc2-4e1a-9f14-0318cd7b8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.358354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-e4e55278-dcc2-4e1a-9f14-0318cd7b8ceb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:42.359557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-e4e55278-dcc2-4e1a-9f14-0318cd7b8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:42.435604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 283/572] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:42.436461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e55278-dcc2-4e1a-9f14-0318cd7b8ceb None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.440805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ede21-112e-48d8-b59b-a98a5044741f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.480814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:42.483485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.484172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.484516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.484739 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.485565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:42.485907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.487422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.500552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 290/573] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:42.501398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.559411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e55278-dcc2-4e1a-9f14-0318cd7b8ceb None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.587084 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:42.597400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.598024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.598306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.599148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.599312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:42.599619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.601180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.612633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 284/574] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:42.613467 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.624622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed0e2-7c60-4817-9fcc-57abbc9480a3 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.665226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.666126 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.666417 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.666696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.677354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.678881 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:42.701263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:42.702476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:42.703494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:42.703494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:42.703494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:42.703494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:42.710956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 291/575] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:42.710956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.713777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:42.716790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219236-fc1b-49c1-bb36-8e740d96b2ff None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.754428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.755216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.755496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.755772 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.767457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.768905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:42.787324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:42.789246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:42.790180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:42.790180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:42.790180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:42.790180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:42.790180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 285/576] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:42.790180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.825136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc1bd-5897-4c30-a6c0-28a3fc75a172 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.851830 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:42.871506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd767b-7350-4303-b7ae-ccb2a1382f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.873033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd767b-7350-4303-b7ae-ccb2a1382f50 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.873033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd767b-7350-4303-b7ae-ccb2a1382f50 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.873222 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd767b-7350-4303-b7ae-ccb2a1382f50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.884971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd767b-7350-4303-b7ae-ccb2a1382f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-f3cd767b-7350-4303-b7ae-ccb2a1382f50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:42.892751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:42.893935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 292/577] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:42.900075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd767b-7350-4303-b7ae-ccb2a1382f50 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.917459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedeeed-f53b-49e0-b390-ad5a67460e34 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:42.954405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:42.955068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:42.955353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:42.955635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:42.956474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=a2759d80c45b46bda24dd9509ea089ac) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:42.956793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:42.958283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:42.964198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 286/578] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/role_assignments?user.id=a2759d80c45b46bda24dd9509ea089ac&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:42.964198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:42.998982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:43.018127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd767b-7350-4303-b7ae-ccb2a1382f50 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.071261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.072456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.072934 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.073407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.082232 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.084437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:43.099560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:43.100595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:43.101640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 293/579] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:43.102355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.122906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca5b0-74c1-42a0-91fe-4a364d551ed4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.163663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:43.174086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.174818 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.175054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.175335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.176183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:43.176392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.177910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.194666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 287/580] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:43.194666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.258643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46735f-eadc-409d-97f2-d7f100d39bd0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.298113 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.298793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.299087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.299372 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.300110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:43.300429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.301879 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.305389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:43.317988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 294/581] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:43.318993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.339230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d4a6-335b-4c1a-836b-22bc6855fb9c None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.381002 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.381591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.381936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.382183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.382965 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:43.383244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.384634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.393725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 288/582] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:43.394583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.451181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c36f1b-7d20-465b-88b4-86ee789ee2f1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.452671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:43.492647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.493330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.493624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.493938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.495024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:43.495149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.496604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.525134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 295/583] 10.222.0.13 () {56 vars in 1137 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:43.525134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.529701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3c14-0452-49e3-bac1-1108aa5d2aac None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.568111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.568913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.569205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.569482 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] PATH_INFO: `/v3/users/glance` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.581059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.582580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.584563 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:43.600149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:43.601220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 289/584] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:43.602325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.662479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373f88d-e733-477a-9dea-ba1605b7d940 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.707212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.708025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.708316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.708597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.716773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.718265 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.726924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d3727-20bb-4772-898e-498924dc946d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:43.732868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:43.739779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 296/585] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:43.741257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.764339 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:43.776653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.777463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.777812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.778102 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.789369 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.793086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:43.811871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:43.812883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:43.813816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:43.813816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:43.813816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:43.813816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:43.813816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 290/586] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:43.814421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.874936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:43.876610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c1c51-73ac-40b1-a07c-342a6c39f2d7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.920686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.921483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.921902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.922266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.934712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.936699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e1449-eccd-4144-ba24-681e9ee8a391 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:43.936835 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:43.954788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:43.955762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:43.956686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:43.956686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:43.956686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:43.956686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:43.956686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 297/587] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:43.957407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:43.976979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:43.977668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:43.978022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:43.978309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:43.979217 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:43.979529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:43.980982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:43.999679 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 291/588] 10.222.0.13 () {56 vars in 1137 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:44.004990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.055894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:44.098070 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92bb82-8d4d-43ba-85e2-40fbfea73292 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.130456 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db804b-0dfc-41eb-a080-3861736b28df None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.142206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:44.148820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.149648 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.149967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.150247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.151079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:44.151389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.152856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.170888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 298/589] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:44.172075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.176273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.176988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.177276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.177554 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.181068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:44.181068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.181068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.198275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 292/590] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:44.198275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.311101 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae39d7-1899-442c-ae5d-8284f6e69a8e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.329604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825fc5-113a-467b-b34c-8a10f8a7ea6a None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.348581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:44.356761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.357449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.357760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.358051 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.358806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:44.359120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.360538 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.372394 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.373518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.374027 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.374207 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 299/591] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:44.374708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.375006 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.391357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.392842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:44.410809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:44.411793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:44.412734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:44.412734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:44.412734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:44.412734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:44.412734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 293/592] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:44.413019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.438200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:44.499911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0194bb-832c-4693-8557-abce9de7e75c None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.526416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8208e2-3cb3-497d-be0b-647494f92da2 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.552770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6715d3-1916-4147-9418-fd1d1e3e2144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.554271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6715d3-1916-4147-9418-fd1d1e3e2144 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.554752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6715d3-1916-4147-9418-fd1d1e3e2144 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.555237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6715d3-1916-4147-9418-fd1d1e3e2144 None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/7ac29fbb131c4ccf9ee7f26c4bd6523c/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.572954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6715d3-1916-4147-9418-fd1d1e3e2144 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=7ac29fbb131c4ccf9ee7f26c4bd6523c, role_id=8cb69f0fee6a4e7295d8a8bc1aff8d03)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.574554 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6715d3-1916-4147-9418-fd1d1e3e2144 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.575585 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.577098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.577703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.578138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.587361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.594074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 300/593] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:36:44 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/7ac29fbb131c4ccf9ee7f26c4bd6523c/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:44.594289 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.594395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6715d3-1916-4147-9418-fd1d1e3e2144 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:44.618288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:44.619315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:44.620869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 294/594] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:44.621471 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.663202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:44.737806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6715d3-1916-4147-9418-fd1d1e3e2144 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.741059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:44.764692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e1aa-ce0d-4197-ad9b-39f7ba4b96b2 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.778194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.779022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.779305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.779585 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.787586 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.789379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:44.807145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:44.808231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 301/595] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:44.809251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.813755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.813755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.813755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.813755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.814370 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:44.814370 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.815647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.831507 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 295/596] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:44.832392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:44.924127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069bb7-1200-43fc-84aa-e62ee0fa00bd None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.925719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:44.951993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045b167-1d93-43c4-9843-8be0e7776ee5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:44.967508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.968907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.969529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:44.970202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:44.971984 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:44.972736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:44.975930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:44.996623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 302/597] 10.222.0.13 () {56 vars in 1139 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:44.996816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:44.997446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:44.998065 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:45.002061 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.002383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.003214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:45.003595 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:45.005317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:45.017017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:45.028569 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 296/598] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:45.028569 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:45.140024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e4341-bfe6-43d1-94f5-4e493ac4482f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:45.163368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854e6b3-d36c-4b2e-8819-568a72b5122b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:45.185174 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:45.186014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.186324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.187179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.198216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:45.200059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:45.203889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:45.204967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.205453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.205989 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:45.217650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:45.219449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:45.220378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:45.220378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:45.220378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:45.220378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:45.220378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:45.220378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:45.220378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:45.220378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:45.223890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 303/599] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:45.224795 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:45.225088 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:45.226981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:45.246843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:45.247786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:45.248678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:45.248678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:45.248678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:45.248678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:45.250269 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:45.252413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 297/600] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:45.253587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:45.317877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:45.355303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3171dae-e7a7-4b9e-8f31-052685c41bea None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:45.376510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41c3c-6795-454b-9d28-dfe1e2fa79b5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:45.395064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae95b59-50b0-4c26-92ae-4ce4bdba2179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:45.395963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95b59-50b0-4c26-92ae-4ce4bdba2179 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.396311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95b59-50b0-4c26-92ae-4ce4bdba2179 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.396601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95b59-50b0-4c26-92ae-4ce4bdba2179 None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/5c27e8bab1f3424aadd7ca66a1e2756f/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.419321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae95b59-50b0-4c26-92ae-4ce4bdba2179 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=5c27e8bab1f3424aadd7ca66a1e2756f, role_id=8cb69f0fee6a4e7295d8a8bc1aff8d03)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:45.420461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:45.420998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae95b59-50b0-4c26-92ae-4ce4bdba2179 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:45.421588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.422113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.422398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.423203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:45.423755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:45.425691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:45.441277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 298/601] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:45.442222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:45.442812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 304/602] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:36:45 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/5c27e8bab1f3424aadd7ca66a1e2756f/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:45.444354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c88d-c345-46bf-89a8-6b907e8705b3 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.444844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c88d-c345-46bf-89a8-6b907e8705b3 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.445311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c88d-c345-46bf-89a8-6b907e8705b3 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.446941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 305/603] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:45.448546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c88d-c345-46bf-89a8-6b907e8705b3 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:45.571614 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:45.572199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d7ff9-d6b6-4dc5-8db5-59a31f8239d2 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:45.593024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:45.621848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93475437-3283-4d0e-9195-fb42d78207ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:45.622667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c88d-c345-46bf-89a8-6b907e8705b3 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:45.623065 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475437-3283-4d0e-9195-fb42d78207ef None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.623584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475437-3283-4d0e-9195-fb42d78207ef None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.624048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475437-3283-4d0e-9195-fb42d78207ef None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.625116 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93475437-3283-4d0e-9195-fb42d78207ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:45.625725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93475437-3283-4d0e-9195-fb42d78207ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:45.627418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93475437-3283-4d0e-9195-fb42d78207ef None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:45.642374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 299/604] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:45.644060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86231436-f17f-4fb7-bbe6-147958d3f597 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.644578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86231436-f17f-4fb7-bbe6-147958d3f597 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.645121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86231436-f17f-4fb7-bbe6-147958d3f597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.663926 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-86231436-f17f-4fb7-bbe6-147958d3f597 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:45.666186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-86231436-f17f-4fb7-bbe6-147958d3f597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:45.667011 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f0c20-d750-4250-b491-12d8f70a9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:45.667925 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0c20-d750-4250-b491-12d8f70a9840 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.668214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0c20-d750-4250-b491-12d8f70a9840 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.668499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0c20-d750-4250-b491-12d8f70a9840 None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/7fc89b93f03e453da2780d75216e0566/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:45.690788 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f0c20-d750-4250-b491-12d8f70a9840 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=7fc89b93f03e453da2780d75216e0566, role_id=8cb69f0fee6a4e7295d8a8bc1aff8d03)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:45.692293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f0c20-d750-4250-b491-12d8f70a9840 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:45.709865 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 306/605] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:36:45 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/7fc89b93f03e453da2780d75216e0566/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:45.711313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f0c20-d750-4250-b491-12d8f70a9840 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:45.804985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 300/606] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:45.829535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86231436-f17f-4fb7-bbe6-147958d3f597 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:45.937929 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f0c20-d750-4250-b491-12d8f70a9840 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:45.959850 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86231436-f17f-4fb7-bbe6-147958d3f597 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:45.962106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:45.972699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:45.994943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:45.995754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:45.996037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:45.996316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:46.005282 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:46.005796 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e097b3-dd38-4701-ad50-bcf54e2c0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:46.006793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e097b3-dd38-4701-ad50-bcf54e2c0026 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:46.007264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e097b3-dd38-4701-ad50-bcf54e2c0026 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:46.007530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:46.007700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e097b3-dd38-4701-ad50-bcf54e2c0026 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:46.022622 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e097b3-dd38-4701-ad50-bcf54e2c0026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:46.023666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:46.024541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:46.025466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 307/607] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-f4e097b3-dd38-4701-ad50-bcf54e2c0026 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:46.032210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:46.034457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:46.036484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:46.038138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:46.044401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 301/608] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:46.050957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e097b3-dd38-4701-ad50-bcf54e2c0026 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:46.173703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e097b3-dd38-4701-ad50-bcf54e2c0026 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:46.210391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d397c06-84ae-4a4a-a986-fdd386dbe29c None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:46.247914 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:46.248951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:46.249475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:46.249989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:46.251008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:46.251671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:46.253404 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:46.268651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 308/609] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:46.272861 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:46.274886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:46.275645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:46.276524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:46.285517 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:46.286662 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:46.287188 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:46.288822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:46.305584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 302/610] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:46.313048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:46.362102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:46.370833 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:46.472178 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f364a2a-580d-4d70-a7e0-58f005cc0480 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:46.523338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1e0d-077a-42cc-b590-74619a195826 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:46.544244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ee32f-c12a-43ea-a778-0ea35ac1504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:46.545607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ee32f-c12a-43ea-a778-0ea35ac1504f None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:46.546799 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ee32f-c12a-43ea-a778-0ea35ac1504f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:46.547465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ee32f-c12a-43ea-a778-0ea35ac1504f None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/5d7bc855c20b431b9aabaee20101b79c/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:46.577680 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ee32f-c12a-43ea-a778-0ea35ac1504f None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=5d7bc855c20b431b9aabaee20101b79c, role_id=8cb69f0fee6a4e7295d8a8bc1aff8d03)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:46.580154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ee32f-c12a-43ea-a778-0ea35ac1504f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:46.592278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:46.593424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:46.594417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:46.595124 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:46.604546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 309/611] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:36:46 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/5d7bc855c20b431b9aabaee20101b79c/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:36:46.614839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:46.616804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:46.638755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:46.639784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:46.640711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:46.640711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:46.640711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:46.640711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:46.643232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 303/612] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:46.650730 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ee32f-c12a-43ea-a778-0ea35ac1504f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:46.762179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:46.772448 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ee32f-c12a-43ea-a778-0ea35ac1504f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:46.827260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:46.828112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:46.828504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:46.828882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:46.829829 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:46.830247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:46.831776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:46.849277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 310/613] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:46.855458 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:46.979951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:47.015121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d799b9-689a-48d8-a9b8-39e9314085c4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:47.064763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edb9e2-423a-4025-9696-4f1da73aeef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:47.065717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb9e2-423a-4025-9696-4f1da73aeef0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:47.066176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb9e2-423a-4025-9696-4f1da73aeef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:47.066550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb9e2-423a-4025-9696-4f1da73aeef0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:47.079132 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edb9e2-423a-4025-9696-4f1da73aeef0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:47.080761 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edb9e2-423a-4025-9696-4f1da73aeef0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-70edb9e2-423a-4025-9696-4f1da73aeef0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:47.096586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:47.097892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:36:47.099086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:47.101000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 304/614] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:36:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:47.106953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:47.150274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c42f66-4421-4fc3-aafb-ebe84a4a2089 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:47.151333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c42f66-4421-4fc3-aafb-ebe84a4a2089 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:47.151714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c42f66-4421-4fc3-aafb-ebe84a4a2089 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:47.153352 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 305/615] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:47.159204 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3555e5-092b-4388-8808-401cb7a38a5d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:47.159618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3555e5-092b-4388-8808-401cb7a38a5d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:47.159995 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3555e5-092b-4388-8808-401cb7a38a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:47.180446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-2f3555e5-092b-4388-8808-401cb7a38a5d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:47.182902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-2f3555e5-092b-4388-8808-401cb7a38a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:47.262205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f4dc1-eb16-4f75-a87a-35164f8bc6fe None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:47.315032 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 306/616] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:47.332521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:47.333550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:47.334033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:47.334464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:47.335741 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:47.336203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:47.337845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:47.353293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3555e5-092b-4388-8808-401cb7a38a5d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:47.365586 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 311/617] 10.222.0.13 () {56 vars in 1135 bytes} [Wed May 25 13:36:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:47.375235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:47.395870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:47.446111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:47.480605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3555e5-092b-4388-8808-401cb7a38a5d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:47.537396 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ce5fb-f8bf-49d8-9150-3ac7b9577ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:47.538675 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce5fb-f8bf-49d8-9150-3ac7b9577ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:47.539176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce5fb-f8bf-49d8-9150-3ac7b9577ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:47.539657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce5fb-f8bf-49d8-9150-3ac7b9577ca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:47.560909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0d4a-0720-499c-886a-8fad827bdbd2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:47.562107 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ce5fb-f8bf-49d8-9150-3ac7b9577ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-021ce5fb-f8bf-49d8-9150-3ac7b9577ca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:47.570433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:47.571399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:47.572242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:47.583778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 307/618] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:47.590453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ce5fb-f8bf-49d8-9150-3ac7b9577ca1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:47.613241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:47.614092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:47.614387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:47.614656 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:47.633544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:47.635646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:47.682405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:47.683413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:47.684310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:47.684310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:47.684310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:47.684310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:47.684310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 312/619] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:47.690543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:47.729883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ce5fb-f8bf-49d8-9150-3ac7b9577ca1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:47.761203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:47.794700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:47.795639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:47.797252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:47.797827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:47.803147 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:47.803672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:47.805244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:47.824993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 308/620] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:47.830514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:47.853577 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:48.056709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde284-5d98-46bb-ad7f-5d861b2bc402 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:48.060802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c343f-6ebd-4573-98dc-6b00a2206eb5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:48.132104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c6cc4-11c1-4d21-8f80-4b6cb9d2d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:48.132830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6cc4-11c1-4d21-8f80-4b6cb9d2d160 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.133114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6cc4-11c1-4d21-8f80-4b6cb9d2d160 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.133393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6cc4-11c1-4d21-8f80-4b6cb9d2d160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.134674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47f613-96a4-45dd-b519-61c529a03892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:48.135402 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47f613-96a4-45dd-b519-61c529a03892 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.135681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47f613-96a4-45dd-b519-61c529a03892 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.135954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47f613-96a4-45dd-b519-61c529a03892 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.136696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47f613-96a4-45dd-b519-61c529a03892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:48.137002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47f613-96a4-45dd-b519-61c529a03892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:48.138431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47f613-96a4-45dd-b519-61c529a03892 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:48.160287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6cc4-11c1-4d21-8f80-4b6cb9d2d160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:48.161881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6cc4-11c1-4d21-8f80-4b6cb9d2d160 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:48.171589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 313/621] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:48.173150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c0e7-db10-479e-a962-057746643292 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.179740 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c0e7-db10-479e-a962-057746643292 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.179740 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c0e7-db10-479e-a962-057746643292 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.179740 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 314/622] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:48.180694 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345c0e7-db10-479e-a962-057746643292 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-875c6cc4-11c1-4d21-8f80-4b6cb9d2d160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:48.201762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:48.202841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:48.203759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:48.203759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:48.203759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:48.203759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:48.217762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 309/623] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:48.217762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fe6a6-495c-4b23-85fd-77d2f585b97a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.217762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fe6a6-495c-4b23-85fd-77d2f585b97a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.217762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fe6a6-495c-4b23-85fd-77d2f585b97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.265756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-764fe6a6-495c-4b23-85fd-77d2f585b97a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:48.265756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-764fe6a6-495c-4b23-85fd-77d2f585b97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:48.343102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345c0e7-db10-479e-a962-057746643292 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:48.377765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:48.390303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:48.400424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:48.405757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.405757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.405757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.418440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:48.419932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:48.435068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:48.436288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:48.437199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:48.437199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:48.437199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:48.437199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:48.437199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:48.437199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:48.437199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:48.437199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:48.441765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 315/624] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:48.442034 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 310/625] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:48.445770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:48.445993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fe6a6-495c-4b23-85fd-77d2f585b97a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:48.601559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3621c-c1be-4eed-8eff-683d63db3c12 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:48.638831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:48.639516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.639802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.640081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.640869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:48.641120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:48.642562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:48.647650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fe6a6-495c-4b23-85fd-77d2f585b97a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:48.655123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 316/626] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:48.660114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:48.686500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cafbe-1e03-453f-a8d9-261a1f27a9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:48.687206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cafbe-1e03-453f-a8d9-261a1f27a9d9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.687461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cafbe-1e03-453f-a8d9-261a1f27a9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.687746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cafbe-1e03-453f-a8d9-261a1f27a9d9 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.688540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cafbe-1e03-453f-a8d9-261a1f27a9d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:48.688853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cafbe-1e03-453f-a8d9-261a1f27a9d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:48.690333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cafbe-1e03-453f-a8d9-261a1f27a9d9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:48.703319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:48.709686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 311/627] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:48.709686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818760c7-dbd2-4257-8b84-abd1aabbe8ab None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.709686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818760c7-dbd2-4257-8b84-abd1aabbe8ab None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.709686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818760c7-dbd2-4257-8b84-abd1aabbe8ab None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.709686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 312/628] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:48.710203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818760c7-dbd2-4257-8b84-abd1aabbe8ab None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:48.753474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:48.772358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da7b5-dfd0-4cc3-90af-730db69e3618 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:48.827280 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25279e-f000-4f64-995a-78d0c3f66f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:48.828201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25279e-f000-4f64-995a-78d0c3f66f82 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.828538 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25279e-f000-4f64-995a-78d0c3f66f82 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.828793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25279e-f000-4f64-995a-78d0c3f66f82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.841399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25279e-f000-4f64-995a-78d0c3f66f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-bd25279e-f000-4f64-995a-78d0c3f66f82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:48.849316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:48.850475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:48.851429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 317/629] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:48.852228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132828e0-b797-4b5c-b550-7953d1acf5ff None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.852228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132828e0-b797-4b5c-b550-7953d1acf5ff None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.852362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132828e0-b797-4b5c-b550-7953d1acf5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.859773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818760c7-dbd2-4257-8b84-abd1aabbe8ab None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:48.870482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-132828e0-b797-4b5c-b550-7953d1acf5ff None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:48.871777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-132828e0-b797-4b5c-b550-7953d1acf5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:48.900363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:48.901785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:48.902085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:48.902393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:48.912282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:48.913759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:48.928561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:48.929637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 313/630] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:36:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:48.930652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:48.965507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 318/631] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:48.967460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132828e0-b797-4b5c-b550-7953d1acf5ff None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:49.012162 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:49.035952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:49.046279 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d21fd-0e92-4632-9ca3-b71154653d00 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.082325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843fc5d-f8cd-4e5a-af67-7d84338d474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:49.083214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843fc5d-f8cd-4e5a-af67-7d84338d474f None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.083497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843fc5d-f8cd-4e5a-af67-7d84338d474f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.083774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843fc5d-f8cd-4e5a-af67-7d84338d474f None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/a2759d80c45b46bda24dd9509ea089ac/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.099960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843fc5d-f8cd-4e5a-af67-7d84338d474f None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=a2759d80c45b46bda24dd9509ea089ac, role_id=8cb69f0fee6a4e7295d8a8bc1aff8d03)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:49.100807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132828e0-b797-4b5c-b550-7953d1acf5ff None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.101412 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843fc5d-f8cd-4e5a-af67-7d84338d474f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:49.118033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 314/632] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:36:48 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/a2759d80c45b46bda24dd9509ea089ac/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:36:49.118873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843fc5d-f8cd-4e5a-af67-7d84338d474f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:49.157932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:49.160065 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.160998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.161526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.162916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:49.164099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:49.166066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:49.183427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 319/633] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:49.183427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:49.285454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843fc5d-f8cd-4e5a-af67-7d84338d474f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.325999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:49.326936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:49.327334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.327831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.328337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.329809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:49.330520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:49.332250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:49.339891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4df5-6ffd-4c3d-a238-fcba9f7f2bd6 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.343880 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:49.357457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 315/634] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:36:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:49.358383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:49.391965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df668e5-b2cc-4953-a78b-3cf29e4dde72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:49.393441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df668e5-b2cc-4953-a78b-3cf29e4dde72 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.393762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df668e5-b2cc-4953-a78b-3cf29e4dde72 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.394040 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df668e5-b2cc-4953-a78b-3cf29e4dde72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.408340 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df668e5-b2cc-4953-a78b-3cf29e4dde72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-6df668e5-b2cc-4953-a78b-3cf29e4dde72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:49.416172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:49.417139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:49.418064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 320/635] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:49.418779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15033b4c-26ea-4907-8735-c0bd29130b69 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.419348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15033b4c-26ea-4907-8735-c0bd29130b69 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.419348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15033b4c-26ea-4907-8735-c0bd29130b69 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.420812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 321/636] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:49.421568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15033b4c-26ea-4907-8735-c0bd29130b69 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:49.481258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0c092-30b0-48a2-b0d6-cf26d4fcdf77 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.524045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba4654-67a3-479f-9ca2-615b9956b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:49.524859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba4654-67a3-479f-9ca2-615b9956b989 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.525141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba4654-67a3-479f-9ca2-615b9956b989 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.525416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba4654-67a3-479f-9ca2-615b9956b989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.544809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15033b4c-26ea-4907-8735-c0bd29130b69 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.557280 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba4654-67a3-479f-9ca2-615b9956b989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:49.559407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba4654-67a3-479f-9ca2-615b9956b989 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-3bba4654-67a3-479f-9ca2-615b9956b989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:49.577939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:49.578961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:49.579869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:49.579869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:49.579869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:49.579869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:49.579869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 316/637] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:49.580592 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fe9a-c68e-4858-a6db-85587fc4c152 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.580704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fe9a-c68e-4858-a6db-85587fc4c152 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.580961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fe9a-c68e-4858-a6db-85587fc4c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.588972 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7fe39-8164-455f-9d88-4649528725ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:49.589658 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7fe39-8164-455f-9d88-4649528725ab None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.589978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7fe39-8164-455f-9d88-4649528725ab None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.590262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7fe39-8164-455f-9d88-4649528725ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.597863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-91f3fe9a-c68e-4858-a6db-85587fc4c152 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:49.599064 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-91f3fe9a-c68e-4858-a6db-85587fc4c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:49.616542 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:49.648173 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:49.672995 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 317/638] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:49.673763 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7fe39-8164-455f-9d88-4649528725ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:49.674148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3fe9a-c68e-4858-a6db-85587fc4c152 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:49.675665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7fe39-8164-455f-9d88-4649528725ab None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:49.797594 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3fe9a-c68e-4858-a6db-85587fc4c152 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.810157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 322/639] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:49.810157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7fe39-8164-455f-9d88-4649528725ab None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:49.840001 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:49.840780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.841139 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.841508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.842385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:49.842772 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:49.844168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:49.857082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 318/640] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:49.857082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:49.872622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:49.907817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:49.926256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7fe39-8164-455f-9d88-4649528725ab None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.962330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:49.963070 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:49.963363 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:49.963639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:49.964384 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:49.964696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:49.966131 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:49.977411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b1c11-8302-4907-bdb3-51cb90e07224 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:49.978066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 323/641] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:49.978973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.020841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3af1d-dd75-47a7-b2b0-9204151cb060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.021793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3af1d-dd75-47a7-b2b0-9204151cb060 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.022078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3af1d-dd75-47a7-b2b0-9204151cb060 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.022364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3af1d-dd75-47a7-b2b0-9204151cb060 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.034729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3af1d-dd75-47a7-b2b0-9204151cb060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-54d3af1d-dd75-47a7-b2b0-9204151cb060 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:50.043288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:50.044299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:50.045156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 319/642] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:50.045901 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3af1d-dd75-47a7-b2b0-9204151cb060 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.100023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a186c-7f5a-4dce-8306-bc38651c3236 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.116972 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:50.140422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.141600 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.141919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.142525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.154947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.156725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.166073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3af1d-dd75-47a7-b2b0-9204151cb060 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.167866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:50.175111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:50.176135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:50.177102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:50.177102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:50.177102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:50.177102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:50.177102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 324/643] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:50.178455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.212411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.213258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.213546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.213904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.226568 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.228066 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:50.249479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:50.250552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:50.251616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:50.251616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:50.251616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:50.251616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:50.251616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 320/644] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:50.251616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.295445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6df6e0-993a-478d-80f3-f0eb8f8c2137 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.340521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.341345 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.341631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.341947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.350554 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.352047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:50.367857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:50.368886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 325/645] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:50.370955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.390849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775a6-af2e-4009-83fc-c4f0eed8a7d9 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.400949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:50.431107 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.431715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.432528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.432809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.433570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:50.433914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.435295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.445326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 321/646] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:50.446376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.475096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:50.485884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa92b13-15f6-4d7a-ba6f-57981afbcaf3 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.529262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.529968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.530251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.530526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.531252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:50.531561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.533401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.550693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 326/647] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:50.550693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.571919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127430-119a-4be9-bbf6-55195d18627b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.606455 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.607123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.607411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.607697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.608414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:50.608726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.610116 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.627311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 322/648] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:50.627311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.640083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:50.658880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533e5-5179-4be7-888a-0411ac5bb1a4 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.696832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.697553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.697884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.698151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.698986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:50.699294 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.700735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.711925 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:50.721457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 327/649] 10.222.0.13 () {56 vars in 1137 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:50.722328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.741653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996803a-324a-474b-8824-63ee22b197e5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.777956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.778755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.779044 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.779324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.796784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.798180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:50.816397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:50.817400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:50.818819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:50.818819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:50.818819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:50.818819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:50.818819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 323/650] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:50.818819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.844378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c552ff-2870-4ba0-b933-781c02b26260 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.882692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.883489 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.883773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.884066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.891421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.893566 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:50.908083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:50.909258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 328/651] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:50.910735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:50.914226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:50.935502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa8148-6731-4d2b-a4dd-802830d2f21c None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:50.972814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:50.983288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:50.984137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:50.984422 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:50.984701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:50.994022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:50.995631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:51.011372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:51.012411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 324/652] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:51.018246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:51.033635 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801c6e8-933e-4bc1-9fae-668baa30a713 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.071069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c444e-75d8-4ce4-93a3-f7d63b13dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.072114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c444e-75d8-4ce4-93a3-f7d63b13dac6 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.073202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c444e-75d8-4ce4-93a3-f7d63b13dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.073488 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c444e-75d8-4ce4-93a3-f7d63b13dac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.131249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f7bcb-9bd0-49e9-ac0d-4156fd2d6123 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.147196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c444e-75d8-4ce4-93a3-f7d63b13dac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.148688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c444e-75d8-4ce4-93a3-f7d63b13dac6 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.151454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:51.173023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.173715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.174007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.174284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.175138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:51.175450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.176974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.194922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 325/653] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:51.194922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:51.258305 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:51.283337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 329/654] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:51.283337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c444e-75d8-4ce4-93a3-f7d63b13dac6 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:51.331947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a219-3dcc-4067-a7ac-155fd335dda1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.366198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.366964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.367247 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.367524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.368303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:51.368612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.370086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.387128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 326/655] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:51.387128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:51.393970 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c444e-75d8-4ce4-93a3-f7d63b13dac6 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.395604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:51.431081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.432930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.433361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.433833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.434833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:51.435310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.436886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.455316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 330/656] 10.222.0.13 () {56 vars in 1137 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:51.456460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:51.488414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275c83-68b5-4eb5-97e8-43a707dbf38e None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.498187 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:51.523729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.524449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.524736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.525018 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.532181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.533623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:51.548672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:51.549691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:51.550718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 327/657] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:51.551341 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:51.570812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e9726-6da1-4e38-8843-8ecac2d41a64 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.605503 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d4133-eda6-4201-b75e-9ded060980b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.606320 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d4133-eda6-4201-b75e-9ded060980b1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.606600 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d4133-eda6-4201-b75e-9ded060980b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.606963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d4133-eda6-4201-b75e-9ded060980b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.616704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d4133-eda6-4201-b75e-9ded060980b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.618192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d4133-eda6-4201-b75e-9ded060980b1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-100d4133-eda6-4201-b75e-9ded060980b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:51.636482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:51.637457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:51.638397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:51.638397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:51.638397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:51.638397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:51.638397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 331/658] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:51.638931 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018806a-62de-48d2-9480-1db37c0610f1 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.639217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018806a-62de-48d2-9480-1db37c0610f1 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.639468 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018806a-62de-48d2-9480-1db37c0610f1 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.640735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 332/659] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:51.641435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018806a-62de-48d2-9480-1db37c0610f1 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:51.652863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3e285-dbb8-418e-bbaa-df32516ce96f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.656811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:51.687566 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.688218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.688501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.688784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.689707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:51.689957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.691398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.697083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 328/660] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/role_assignments?user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:51.698462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:51.743506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:51.754405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018806a-62de-48d2-9480-1db37c0610f1 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.802993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfde185-b6bc-498d-ae41-50d438231295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.803672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde185-b6bc-498d-ae41-50d438231295 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.803965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde185-b6bc-498d-ae41-50d438231295 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.804253 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde185-b6bc-498d-ae41-50d438231295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.830746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8ce57-3bdd-4785-a655-4fbd185ca52d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:51.882801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:51.883489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:51.883777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:51.884055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:51.884791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfde185-b6bc-498d-ae41-50d438231295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.884952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:51.885253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:51.886351 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfde185-b6bc-498d-ae41-50d438231295 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.886739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:51.903699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:51.911387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 329/661] 10.222.0.13 () {56 vars in 1139 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:51.911387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.004429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 333/662] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:52.006009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12704a8-ba15-4196-a361-a577148202af None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.006304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12704a8-ba15-4196-a361-a577148202af None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.006635 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12704a8-ba15-4196-a361-a577148202af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.012098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:52.023512 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f259-5e6e-4ee7-b6c4-6184befb4da3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.023716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-a12704a8-ba15-4196-a361-a577148202af None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:52.024876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a12704a8-ba15-4196-a361-a577148202af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:52.060887 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.062248 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.062248 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.062248 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.062775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:52.063087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:52.064493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:52.081254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 330/663] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:52.081254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.100106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 334/664] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:52.101054 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12704a8-ba15-4196-a361-a577148202af None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.148360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:52.201784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d78e2-ca8f-44f1-8e50-28de7a3df922 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.210176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12704a8-ba15-4196-a361-a577148202af None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.238494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177676-a919-466b-aee9-b6a003a7c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.239055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177676-a919-466b-aee9-b6a003a7c859 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.239455 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177676-a919-466b-aee9-b6a003a7c859 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.239860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177676-a919-466b-aee9-b6a003a7c859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.252062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.252860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.253146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.253526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.260720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:52.264932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:52.266396 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:52.285880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:52.287058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:52.288252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:52.288252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:52.288252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:52.288252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:52.290204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 335/665] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:52.290839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.319469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75177676-a919-466b-aee9-b6a003a7c859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:52.320854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75177676-a919-466b-aee9-b6a003a7c859 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:52.409243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:52.419947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27b75f-ab1c-493d-968c-3ef19a8f007b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.437863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 331/666] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:52.437863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177676-a919-466b-aee9-b6a003a7c859 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.468044 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.468940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.469132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.469410 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.477554 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:52.480146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:52.490437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:52.498546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:52.499622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:52.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:52.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:52.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:52.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:52.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:52.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:52.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:52.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:52.500968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 336/667] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:52.501491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.553595 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177676-a919-466b-aee9-b6a003a7c859 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.594438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224c2ce-c55a-4350-917e-1d94498010f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.595155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224c2ce-c55a-4350-917e-1d94498010f7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.595431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224c2ce-c55a-4350-917e-1d94498010f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.595707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224c2ce-c55a-4350-917e-1d94498010f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.606957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224c2ce-c55a-4350-917e-1d94498010f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-a224c2ce-c55a-4350-917e-1d94498010f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:52.614990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:52.616196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 332/668] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:52.617269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224c2ce-c55a-4350-917e-1d94498010f7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.631807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e7cf-a922-43cd-8eab-6704f2ec79c9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.669617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.670317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.670604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.670887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.671622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:52.671925 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:52.673314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:52.685752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 337/669] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:52.686610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.703928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:52.735199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224c2ce-c55a-4350-917e-1d94498010f7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.746249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:52.773356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.774189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.774468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.774749 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.786469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:52.787950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:52.805608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:52.806624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:52.807596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:52.807596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:52.807596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:52.807596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:52.807821 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98526b-0748-40a4-88c6-f198c02193ba None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.807897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 333/670] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:52.808382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.850708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.851294 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.851586 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.851870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.852679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:52.852994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:52.854517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:52.871271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 338/671] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:52.871271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:52.936890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b97e6f-c632-4cb6-be24-ca7c4f0899c8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:52.976212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:52.976880 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:52.977170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:52.977459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:52.978237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:52.978574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:52.979956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:52.985871 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:52.988825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 334/672] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:52.989724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.018463 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bba14-83e4-4855-ace8-88e9fa90b662 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.018786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:53.054158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.054964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.055248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.055525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.062972 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.064464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:53.079201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:53.080159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 339/673] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:53.086486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.102653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913e773-5aa5-4cb4-86e8-2ad7084fe100 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.138948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.139613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.139900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.140179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.140908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:53.141221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.143079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.158117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 335/674] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:53.158117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.202536 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580bf6-f465-4bd7-a5e0-836c826aa265 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.239515 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.240181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.240473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.240754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.241590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=5c27e8bab1f3424aadd7ca66a1e2756f) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:53.241959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.242757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:53.243441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.246535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:53.254088 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 340/675] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/role_assignments?user.id=5c27e8bab1f3424aadd7ca66a1e2756f&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:53.255413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.263649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f9ba4-40d1-4ccd-b8b9-8cb8c4911e1d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.309114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.310148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.310539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.310978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.327637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.329658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:53.354627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:53.355797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:53.356919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:53.356919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:53.356919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:53.356919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:53.359726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 336/676] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:53.361089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.397138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f763e07-b105-4743-b5cc-961b83f6a3c1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.441201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.442756 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.443233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.443684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.444666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:53.445140 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.446885 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.464486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 341/677] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:53.466044 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.526277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61938-1ed5-476a-8daa-8eaf97357565 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.554094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:53.578396 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.579537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.579985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.580420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.589570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:53.596495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.599732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.608624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fcbb0-1ac6-41e4-b55a-6210c26a9233 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:53.621119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:53.622178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:53.623119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:53.623119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:53.623119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:53.623119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:53.623119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:53.623119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:53.623119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:53.623119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:53.623577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 337/678] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:53.629434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.662822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.663970 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.664469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.664981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.666829 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:53.667467 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.669112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.683700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 342/679] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:53.685003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.747351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264cba5-5ac0-4940-901d-a639a5abd564 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.788282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.788952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.794892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.795187 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.796119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=7fc89b93f03e453da2780d75216e0566) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:53.796446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.798246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.811274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 338/680] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/role_assignments?user.id=7fc89b93f03e453da2780d75216e0566&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:53.811274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:53.819512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec353604-f964-4fbf-9879-ef7cc1db282e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.859790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:53.882454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:53.906660 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:53.907616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:53.907910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:53.909155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:53.910856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:53.911180 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:53.912928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:53.942854 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 343/681] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:53.948480 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29bf35-d8ca-4d68-8737-607264b15d76 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:53.950149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:54.063113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4081526-5c1b-4af2-9988-2706bd122322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:54.063940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081526-5c1b-4af2-9988-2706bd122322 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.064221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081526-5c1b-4af2-9988-2706bd122322 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.064497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081526-5c1b-4af2-9988-2706bd122322 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.070252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439edf5-5e5a-4b8a-a131-e737b457e34a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:54.080319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4081526-5c1b-4af2-9988-2706bd122322 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:54.081812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4081526-5c1b-4af2-9988-2706bd122322 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-b4081526-5c1b-4af2-9988-2706bd122322 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:54.098350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:54.099386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:54.100338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 339/682] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:54.101501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248d5d-aa4b-4650-8d0f-5a199ebb6c7e None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.101501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248d5d-aa4b-4650-8d0f-5a199ebb6c7e None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.101684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248d5d-aa4b-4650-8d0f-5a199ebb6c7e None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.108492 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 340/683] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:54.109414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0248d5d-aa4b-4650-8d0f-5a199ebb6c7e None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:54.117128 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd27045-19f7-4bad-acf6-f9909c266f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:54.117748 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd27045-19f7-4bad-acf6-f9909c266f2b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.118043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd27045-19f7-4bad-acf6-f9909c266f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.118326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd27045-19f7-4bad-acf6-f9909c266f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.119339 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd27045-19f7-4bad-acf6-f9909c266f2b None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=5d7bc855c20b431b9aabaee20101b79c) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:54.119658 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd27045-19f7-4bad-acf6-f9909c266f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:54.121134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd27045-19f7-4bad-acf6-f9909c266f2b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:54.129174 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 344/684] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:53 2022] GET /identity/v3/role_assignments?user.id=5d7bc855c20b431b9aabaee20101b79c&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:54.133295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224693c-5abb-4f2f-99a6-9cb00c60ed50 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.133295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224693c-5abb-4f2f-99a6-9cb00c60ed50 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.133295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224693c-5abb-4f2f-99a6-9cb00c60ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.152913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-e224693c-5abb-4f2f-99a6-9cb00c60ed50 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:54.154926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e224693c-5abb-4f2f-99a6-9cb00c60ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:54.208418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:54.252555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0248d5d-aa4b-4650-8d0f-5a199ebb6c7e None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:54.265774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 345/685] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:54.285030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:54.288607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224693c-5abb-4f2f-99a6-9cb00c60ed50 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:54.310206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:54.311332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.311835 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.312213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.313192 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:54.313610 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:54.315494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:54.339148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 341/686] 10.222.0.13 () {56 vars in 1135 bytes} [Wed May 25 13:36:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:54.345934 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:54.445176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224693c-5abb-4f2f-99a6-9cb00c60ed50 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:54.496128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a6ff1-e7d3-46c0-817d-cf01219124bf None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:54.500536 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997b6d0-f8e0-4024-b0bc-ff22dffefa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:54.501423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997b6d0-f8e0-4024-b0bc-ff22dffefa6d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.501717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997b6d0-f8e0-4024-b0bc-ff22dffefa6d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.502106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997b6d0-f8e0-4024-b0bc-ff22dffefa6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.521789 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997b6d0-f8e0-4024-b0bc-ff22dffefa6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-2997b6d0-f8e0-4024-b0bc-ff22dffefa6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:54.530505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:54.531548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:54.532395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:54.536072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 346/687] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:54.538043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997b6d0-f8e0-4024-b0bc-ff22dffefa6d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:54.545335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f26f-3edb-41e5-965d-06f7c70d4513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:54.546034 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f26f-3edb-41e5-965d-06f7c70d4513 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.546323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f26f-3edb-41e5-965d-06f7c70d4513 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.546664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f26f-3edb-41e5-965d-06f7c70d4513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.577616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:54.601350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:54.637811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f26f-3edb-41e5-965d-06f7c70d4513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:54.639335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f26f-3edb-41e5-965d-06f7c70d4513 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:54.683786 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997b6d0-f8e0-4024-b0bc-ff22dffefa6d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:54.769046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 342/688] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:54.774766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f26f-3edb-41e5-965d-06f7c70d4513 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:54.775744 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:54.776429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.776714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.776993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.777766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:54.778079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:54.781534 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:54.809086 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 347/689] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:54.814669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:54.862114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:54.887151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f26f-3edb-41e5-965d-06f7c70d4513 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:54.927972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:54.928787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:54.929073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:54.929351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:54.949641 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:54.951153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:54.991084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:54.992080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:54.992990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:54.992990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:54.992990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:54.992990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:54.994249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 343/690] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:55.000294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:55.026185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:55.037388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6f05-fe43-4537-8e2d-038445f698cf None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:55.128151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:55.128977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:55.129267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:55.129552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:55.152532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:55.153015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ba0d6-6ddf-4e16-84cb-0540b8a74737 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:55.154052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:55.182691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:55.183668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:55.184579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:55.184579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:55.184579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:55.184579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:55.184579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 348/691] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:55.185470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:55.189778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:55.191200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:55.191887 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:55.192211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:55.192499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:55.193592 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:55.194172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:55.195762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:55.208789 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 344/692] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:55.215198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:55.374874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f74817-4e27-424c-96c5-9fd5ba6edec3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:55.426638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277c05d-2157-452e-85f2-50314288f4dc None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:55.451740 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:55.452544 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:55.452831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:55.453110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:55.468394 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:55.470333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:55.488603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:55.489588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:55.490561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 345/693] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:55.500652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:55.510641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:55.511696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:55.512209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:55.512716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:55.513715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:55.514260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:55.515879 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:55.533691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 349/694] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:55.537138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:55.547516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:55.601691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:55.673551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e5feb-177e-4e58-b8f3-30e249d64afe None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:55.735923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:55.736614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:55.736893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:55.737222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:55.737997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:55.738313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:55.739778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:55.746857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c02d-2a54-44a0-be12-6c1f039a0896 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:55.763784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 346/695] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:55.771645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:55.821695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:55.823032 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:55.823598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:55.824105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:55.845927 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:55.848692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:36:55.881067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:55.882172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:55.883182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 350/696] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:36:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:55.888393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:55.927438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecc5d2-c8a2-4145-9f3d-698dc0971cb5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:55.939634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:55.963697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:55.968628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851bfc1-e2ec-4e62-a960-b4e14ad3c456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:55.969954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851bfc1-e2ec-4e62-a960-b4e14ad3c456 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:55.970468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851bfc1-e2ec-4e62-a960-b4e14ad3c456 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:55.970953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851bfc1-e2ec-4e62-a960-b4e14ad3c456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:55.972037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851bfc1-e2ec-4e62-a960-b4e14ad3c456 None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=a2759d80c45b46bda24dd9509ea089ac) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:55.972563 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851bfc1-e2ec-4e62-a960-b4e14ad3c456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:55.974477 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851bfc1-e2ec-4e62-a960-b4e14ad3c456 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:55.984057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 347/697] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:55 2022] GET /identity/v3/role_assignments?user.id=a2759d80c45b46bda24dd9509ea089ac&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:55.990477 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1266-e8be-4f11-8b7f-97f3020aeecc None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:55.991099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1266-e8be-4f11-8b7f-97f3020aeecc None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:55.991581 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1266-e8be-4f11-8b7f-97f3020aeecc None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:55.993586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 348/698] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:55.999859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49797c-4af8-466d-a017-08910aae2e36 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.000529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49797c-4af8-466d-a017-08910aae2e36 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.001127 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49797c-4af8-466d-a017-08910aae2e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.008540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f854-4d8c-476b-9d4f-3d33de0abe21 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:56.023692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-6f49797c-4af8-466d-a017-08910aae2e36 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:56.025415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-6f49797c-4af8-466d-a017-08910aae2e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:56.047428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:56.048134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.048420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.048704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.050324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:56.050653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:56.052210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:56.075762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 351/699] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:36:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:56.082878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:56.143094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 349/700] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:56.167303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49797c-4af8-466d-a017-08910aae2e36 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:56.285108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1409a0c-2819-49f8-b782-3d5921709fea None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:56.318465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:56.334609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707801-fe02-4095-99f5-b24fb91b1f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:56.335962 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707801-fe02-4095-99f5-b24fb91b1f1f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.336696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707801-fe02-4095-99f5-b24fb91b1f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.337183 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707801-fe02-4095-99f5-b24fb91b1f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.340481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49797c-4af8-466d-a017-08910aae2e36 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:56.344583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:56.395834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:56.397384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.397912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.398383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.399690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:56.401551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:56.421142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:56.422504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:36:56.423598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:56.426664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 350/701] 10.222.0.13 () {56 vars in 1129 bytes} [Wed May 25 13:36:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:56.429300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b707801-fe02-4095-99f5-b24fb91b1f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:56.431618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b707801-fe02-4095-99f5-b24fb91b1f1f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:56.433257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:56.561974 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 352/702] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:36:56.567987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707801-fe02-4095-99f5-b24fb91b1f1f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:56.574058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab7d05-0b74-4016-b8c1-03e9e3e3d988 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:56.601452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:56.632153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:56.633105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.633827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.634142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.634915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:56.635237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:56.637243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:56.647841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 351/703] 10.222.0.13 () {56 vars in 1124 bytes} [Wed May 25 13:36:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:56.654123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:56.693501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707801-fe02-4095-99f5-b24fb91b1f1f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:56.694594 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:56.733129 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b758a2-e430-40b2-aff0-01e0a27df126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:56.733984 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b758a2-e430-40b2-aff0-01e0a27df126 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.734279 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b758a2-e430-40b2-aff0-01e0a27df126 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.734563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b758a2-e430-40b2-aff0-01e0a27df126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.745886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b758a2-e430-40b2-aff0-01e0a27df126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:56.747383 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b758a2-e430-40b2-aff0-01e0a27df126 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-d4b758a2-e430-40b2-aff0-01e0a27df126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:56.766891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:56.767873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:56.768797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:56.768797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:56.768797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:56.768797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:56.772730 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 353/704] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:56.772947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dbdb6-04bb-458f-8446-f909f7868a7d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:56.774230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa05e-5a40-4f73-8390-253e179a6722 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.774526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa05e-5a40-4f73-8390-253e179a6722 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.774813 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa05e-5a40-4f73-8390-253e179a6722 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.777009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 354/705] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:56.778252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afa05e-5a40-4f73-8390-253e179a6722 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:56.814979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60e828-6f2a-4c51-8104-afc657beaa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:56.815575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60e828-6f2a-4c51-8104-afc657beaa9c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.815865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60e828-6f2a-4c51-8104-afc657beaa9c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.816161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60e828-6f2a-4c51-8104-afc657beaa9c None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.817295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60e828-6f2a-4c51-8104-afc657beaa9c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:56.817879 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60e828-6f2a-4c51-8104-afc657beaa9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:56.819452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60e828-6f2a-4c51-8104-afc657beaa9c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:56.826156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 352/706] 10.222.0.13 () {56 vars in 1124 bytes} [Wed May 25 13:36:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:36:56.827528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492a6e-fcf8-4fcd-9a00-23bd68240d03 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.827826 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492a6e-fcf8-4fcd-9a00-23bd68240d03 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.828110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492a6e-fcf8-4fcd-9a00-23bd68240d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.847682 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-1d492a6e-fcf8-4fcd-9a00-23bd68240d03 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:56.848907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-1d492a6e-fcf8-4fcd-9a00-23bd68240d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:56.868998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:56.900297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afa05e-5a40-4f73-8390-253e179a6722 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:56.930946 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 353/707] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:56.940340 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:56.941034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:56.941327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:56.941608 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:56.942372 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:56.942686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:56.944093 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:56.956721 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d492a6e-fcf8-4fcd-9a00-23bd68240d03 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:56.961870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 355/708] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:56.964288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:56.988353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:57.068910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d492a6e-fcf8-4fcd-9a00-23bd68240d03 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:57.116249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30515be5-e9ce-4b5b-bd61-432d6eecb648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:57.116249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30515be5-e9ce-4b5b-bd61-432d6eecb648 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.116249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30515be5-e9ce-4b5b-bd61-432d6eecb648 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.116249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30515be5-e9ce-4b5b-bd61-432d6eecb648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.127322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88722b6-f714-4371-8ede-a0954b5bcca0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:57.128170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30515be5-e9ce-4b5b-bd61-432d6eecb648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:57.129824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30515be5-e9ce-4b5b-bd61-432d6eecb648 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-30515be5-e9ce-4b5b-bd61-432d6eecb648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:57.149237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:57.150245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:57.151820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:57.151820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:57.151820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:57.151820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:57.151820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 354/709] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:57.152789 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1054-b2a7-42fe-8e49-52306ecf4213 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.153083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1054-b2a7-42fe-8e49-52306ecf4213 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.153368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1054-b2a7-42fe-8e49-52306ecf4213 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.159559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 355/710] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:57.160387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1054-b2a7-42fe-8e49-52306ecf4213 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:57.174738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd3d7a-db29-4335-ac65-5ac9543ecb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:57.175552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd3d7a-db29-4335-ac65-5ac9543ecb63 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.175837 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd3d7a-db29-4335-ac65-5ac9543ecb63 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.176114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd3d7a-db29-4335-ac65-5ac9543ecb63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.181269 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:57.187595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd3d7a-db29-4335-ac65-5ac9543ecb63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:57.189901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd3d7a-db29-4335-ac65-5ac9543ecb63 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-49dd3d7a-db29-4335-ac65-5ac9543ecb63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:36:57.206887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:57.207842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:57.208745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:36:57.208745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:36:57.208745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:36:57.208745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:36:57.208745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:36:57.208745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:36:57.208745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:36:57.208745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:57.211545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 356/711] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:57.213887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31234f-1cbb-4834-bff2-f2f8fc191678 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.214377 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31234f-1cbb-4834-bff2-f2f8fc191678 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.214832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31234f-1cbb-4834-bff2-f2f8fc191678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.232880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-dd31234f-1cbb-4834-bff2-f2f8fc191678 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:57.234480 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-dd31234f-1cbb-4834-bff2-f2f8fc191678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:57.255922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:57.282228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1054-b2a7-42fe-8e49-52306ecf4213 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:57.310077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 357/712] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:36:57.311479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31234f-1cbb-4834-bff2-f2f8fc191678 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:57.320610 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:57.321420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.321958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.322780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.323578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:57.323944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:57.325487 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:57.340110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 356/713] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:57.345548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:57.438613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31234f-1cbb-4834-bff2-f2f8fc191678 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:57.466099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:57.475083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:57.475975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.476781 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.477190 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7c5b-cbf1-4d29-a526-37d60e4a782b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:57.477555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.478643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:57.479332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:57.481634 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:57.498860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 358/714] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:57.499887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:57.520513 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:57.521415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.521706 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.522025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] PATH_INFO: `/v3/services/network` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.522691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:57.524163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:57.537535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:57.538616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:36:57.539491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:57.543896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 357/715] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:36:57 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:57.544951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:57.548015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:57.609429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c144f-28c5-4010-904a-19448f2ce6ba None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:57.645582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da94e3-176e-4aa8-94ee-e0a25aeaf7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:57.646314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da94e3-176e-4aa8-94ee-e0a25aeaf7c4 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.646729 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da94e3-176e-4aa8-94ee-e0a25aeaf7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.647015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da94e3-176e-4aa8-94ee-e0a25aeaf7c4 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.647892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da94e3-176e-4aa8-94ee-e0a25aeaf7c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:57.649254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da94e3-176e-4aa8-94ee-e0a25aeaf7c4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:57.657605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89176b7a-1ce6-44b6-bc32-0d90b21e0bbf None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:57.672664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 359/716] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:36:57 2022] POST /identity/v3/users => generated 254 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:36:57.673695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da94e3-176e-4aa8-94ee-e0a25aeaf7c4 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:57.699452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:57.700548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.701166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.701652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.702759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=c0b98559906540c082df06432223b497, user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:57.703317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:57.705319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:57.713856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 358/717] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:36:57 2022] GET /identity/v3/role_assignments?user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c&scope.project.id=c0b98559906540c082df06432223b497&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:57.726219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:57.800693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da94e3-176e-4aa8-94ee-e0a25aeaf7c4 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:57.840785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a73f30-0746-48a9-96a9-6be5bf701cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:57.841485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a73f30-0746-48a9-96a9-6be5bf701cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:57.841795 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a73f30-0746-48a9-96a9-6be5bf701cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:57.842078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a73f30-0746-48a9-96a9-6be5bf701cd3 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:57.842859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a73f30-0746-48a9-96a9-6be5bf701cd3 None admin] RBAC: Adding query filter params (name=network) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:57.843175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a73f30-0746-48a9-96a9-6be5bf701cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:57.844667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a73f30-0746-48a9-96a9-6be5bf701cd3 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:57.850721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 360/718] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:36:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:57.856244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:57.949511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:58.110650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d3a9f-b6f3-4d96-966b-aa8a1f807b5d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:58.146211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4794e6-f03d-4f19-8c5a-47038bf3246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:58.146885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4794e6-f03d-4f19-8c5a-47038bf3246d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:58.147229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4794e6-f03d-4f19-8c5a-47038bf3246d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:58.147517 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4794e6-f03d-4f19-8c5a-47038bf3246d None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:58.148228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4794e6-f03d-4f19-8c5a-47038bf3246d None admin] RBAC: Adding query filter params (type=network) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:58.148536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4794e6-f03d-4f19-8c5a-47038bf3246d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:58.149958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4794e6-f03d-4f19-8c5a-47038bf3246d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:58.155751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 359/719] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:36:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:59.045902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd753d5-69fc-4381-a0dc-2fbc57d6e53d None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:59.046392 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd753d5-69fc-4381-a0dc-2fbc57d6e53d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:59.046392 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd753d5-69fc-4381-a0dc-2fbc57d6e53d None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:59.048015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 361/720] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:59.053674 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4f982-65e0-4b3f-acc9-ae00099ef91a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:59.053999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4f982-65e0-4b3f-acc9-ae00099ef91a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:59.054281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4f982-65e0-4b3f-acc9-ae00099ef91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:59.082920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-09b4f982-65e0-4b3f-acc9-ae00099ef91a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:59.084158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-09b4f982-65e0-4b3f-acc9-ae00099ef91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:59.176284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 360/721] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:59.212367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd753d5-69fc-4381-a0dc-2fbc57d6e53d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:59.347611 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd753d5-69fc-4381-a0dc-2fbc57d6e53d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:59.356374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:59.394720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee55177-7242-4d89-bf82-a9a8588b0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:59.395530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55177-7242-4d89-bf82-a9a8588b0c3b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:59.395818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55177-7242-4d89-bf82-a9a8588b0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:59.396103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55177-7242-4d89-bf82-a9a8588b0c3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:59.411072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee55177-7242-4d89-bf82-a9a8588b0c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-5ee55177-7242-4d89-bf82-a9a8588b0c3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:36:59.419258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:59.420241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:36:59.421108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 362/722] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:36:59.426304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4f982-65e0-4b3f-acc9-ae00099ef91a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:59.498677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:59.545542 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318919b7-77c1-42ff-a735-71348103a9e2 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:59.546212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318919b7-77c1-42ff-a735-71348103a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:59.546650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318919b7-77c1-42ff-a735-71348103a9e2 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:59.552556 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4f982-65e0-4b3f-acc9-ae00099ef91a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:59.552794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 363/723] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:36:59.562338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039830-0b7b-4f2e-8783-ba834eec14e8 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:59.562884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039830-0b7b-4f2e-8783-ba834eec14e8 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:59.563358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039830-0b7b-4f2e-8783-ba834eec14e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:59.593603 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-17039830-0b7b-4f2e-8783-ba834eec14e8 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:36:59.595236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-17039830-0b7b-4f2e-8783-ba834eec14e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:36:59.599155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:59.599529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:59.599819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:59.600148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:59.600916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:36:59.601227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:59.602644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:59.622652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 361/724] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:36:59.627943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:59.706726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 364/725] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 13:36:59.755324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039830-0b7b-4f2e-8783-ba834eec14e8 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:59.758006 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27419eb-522c-44e4-a572-5a917b6b3abd None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:59.808741 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:59.828694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:59.829509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:59.829820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:59.830100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:59.845450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:59.847051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:59.879985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:36:59.885214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:36:59.886537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:36:59.887688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:36:59.887688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:36:59.887688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:36:59.887688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:36:59.887966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039830-0b7b-4f2e-8783-ba834eec14e8 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:36:59.894954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 362/726] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:36:59.900009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:36:59.926131 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f787-c662-4d15-8555-a11565c9957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:36:59.927439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f787-c662-4d15-8555-a11565c9957f None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:36:59.927830 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f787-c662-4d15-8555-a11565c9957f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:36:59.928220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f787-c662-4d15-8555-a11565c9957f None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:36:59.929255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f787-c662-4d15-8555-a11565c9957f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:36:59.930856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f787-c662-4d15-8555-a11565c9957f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:36:59.951348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 365/727] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:36:59 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:37:00.097932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0f1e7-2626-4644-a2f7-f129c5390034 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:00.163241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:00.164173 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:00.164604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:00.165023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:00.165978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:00.166435 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:00.167979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:00.185526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 363/728] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:00.191146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f787-c662-4d15-8555-a11565c9957f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:00.318703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f787-c662-4d15-8555-a11565c9957f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:00.356257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4372d6-d290-4d9f-80cd-69316c97ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:00.357074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4372d6-d290-4d9f-80cd-69316c97ca1f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:00.357368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4372d6-d290-4d9f-80cd-69316c97ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:00.357653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4372d6-d290-4d9f-80cd-69316c97ca1f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:00.365719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4372d6-d290-4d9f-80cd-69316c97ca1f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:00.367227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4372d6-d290-4d9f-80cd-69316c97ca1f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-1d4372d6-d290-4d9f-80cd-69316c97ca1f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:00.382322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:00.383329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:00.385217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 366/729] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:00.394896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:00.424092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676d6e2-b8aa-404a-a32b-0efe08b8c796 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:00.424455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676d6e2-b8aa-404a-a32b-0efe08b8c796 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:00.425134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676d6e2-b8aa-404a-a32b-0efe08b8c796 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:00.427665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 367/730] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:00.432751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:00.439255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7140b-aa86-43ff-b09a-b2fd0cd2f64a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:00.440127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7140b-aa86-43ff-b09a-b2fd0cd2f64a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:00.440419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7140b-aa86-43ff-b09a-b2fd0cd2f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:00.465565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-60c7140b-aa86-43ff-b09a-b2fd0cd2f64a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:00.467532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-60c7140b-aa86-43ff-b09a-b2fd0cd2f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:00.489404 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:00.518722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b48011-e0e8-4862-9c5b-e4373af1eddb None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:00.554652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 368/731] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:37:00.571432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:00.572182 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:00.572975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:00.573254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:00.574217 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:00.574531 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:00.576008 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:00.586976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7140b-aa86-43ff-b09a-b2fd0cd2f64a None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:00.599907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 364/732] 10.222.0.13 () {56 vars in 1135 bytes} [Wed May 25 13:37:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:00.606775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:00.715406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:00.727898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbf71-2db3-4a7f-80aa-8d609795a788 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:00.733159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7140b-aa86-43ff-b09a-b2fd0cd2f64a None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:00.770721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e7729-9bc1-42ca-84b7-7e9298f5ea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:00.772189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7729-9bc1-42ca-84b7-7e9298f5ea38 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:00.772701 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7729-9bc1-42ca-84b7-7e9298f5ea38 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:00.773179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7729-9bc1-42ca-84b7-7e9298f5ea38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:00.799559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e7729-9bc1-42ca-84b7-7e9298f5ea38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-0e7e7729-9bc1-42ca-84b7-7e9298f5ea38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:00.808938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:00.810025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:00.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:00.813895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 369/733] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:00.819692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e7729-9bc1-42ca-84b7-7e9298f5ea38 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:00.828613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea215e-8dbe-4b7b-8845-b6e7d14707a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:00.831308 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea215e-8dbe-4b7b-8845-b6e7d14707a9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:00.833271 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea215e-8dbe-4b7b-8845-b6e7d14707a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:00.833781 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea215e-8dbe-4b7b-8845-b6e7d14707a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:00.858114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:00.924891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea215e-8dbe-4b7b-8845-b6e7d14707a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:00.926795 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea215e-8dbe-4b7b-8845-b6e7d14707a9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:00.983653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e7729-9bc1-42ca-84b7-7e9298f5ea38 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.018709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6070f-56f7-4639-948e-cb2ad00755b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.019420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6070f-56f7-4639-948e-cb2ad00755b9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.019712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6070f-56f7-4639-948e-cb2ad00755b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.019996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6070f-56f7-4639-948e-cb2ad00755b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.020779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6070f-56f7-4639-948e-cb2ad00755b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:01.021100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6070f-56f7-4639-948e-cb2ad00755b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.022627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6070f-56f7-4639-948e-cb2ad00755b9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:01.033450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 370/734] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:37:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:01.039468 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0e09-309f-4635-a89c-7c56cfe1960c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.039811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0e09-309f-4635-a89c-7c56cfe1960c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.040052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0e09-309f-4635-a89c-7c56cfe1960c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.041913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 371/735] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:01.043436 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0e09-309f-4635-a89c-7c56cfe1960c None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.048635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:01.065490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 365/736] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 13:37:01.067150 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f344d-9440-4599-b2cb-427f32ed9464 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.067676 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f344d-9440-4599-b2cb-427f32ed9464 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.068173 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f344d-9440-4599-b2cb-427f32ed9464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.086079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-a08f344d-9440-4599-b2cb-427f32ed9464 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:01.087641 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-a08f344d-9440-4599-b2cb-427f32ed9464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:01.118349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:01.161666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0e09-309f-4635-a89c-7c56cfe1960c None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.162793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 366/737] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:37:01.163867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f344d-9440-4599-b2cb-427f32ed9464 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.206113 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.208274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.208820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.209309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.227270 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.229717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:01.249996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:01.251194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:01.252328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:01.252328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:01.252328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:01.252328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:01.253964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 372/738] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:01.254951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.277658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f344d-9440-4599-b2cb-427f32ed9464 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.298258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:01.314627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b0761-252b-4a2c-9f7f-2cbfa5a93bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.315421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b0761-252b-4a2c-9f7f-2cbfa5a93bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.315701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b0761-252b-4a2c-9f7f-2cbfa5a93bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.315972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b0761-252b-4a2c-9f7f-2cbfa5a93bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.327609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b0761-252b-4a2c-9f7f-2cbfa5a93bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.329063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b0761-252b-4a2c-9f7f-2cbfa5a93bf9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-451b0761-252b-4a2c-9f7f-2cbfa5a93bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:01.347428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:01.348405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:01.349344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:01.349344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:01.349344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:01.349344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:01.349344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 367/739] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:01.350228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c6e3-0cba-4ab5-b454-f66e7b8a4e97 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.350228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c6e3-0cba-4ab5-b454-f66e7b8a4e97 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.350470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c6e3-0cba-4ab5-b454-f66e7b8a4e97 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.353863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 368/740] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:01.353863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52c6e3-0cba-4ab5-b454-f66e7b8a4e97 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.372289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5be4d-888f-475a-940f-f0871addeed9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.394084 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:01.409987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b350f2-6c1b-432e-a9ff-ec9df241e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.410804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b350f2-6c1b-432e-a9ff-ec9df241e735 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.411094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b350f2-6c1b-432e-a9ff-ec9df241e735 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.411379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b350f2-6c1b-432e-a9ff-ec9df241e735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.422314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b350f2-6c1b-432e-a9ff-ec9df241e735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-55b350f2-6c1b-432e-a9ff-ec9df241e735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:01.430189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:01.431165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:01.432501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 373/741] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:01.433238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b350f2-6c1b-432e-a9ff-ec9df241e735 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.469473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52c6e3-0cba-4ab5-b454-f66e7b8a4e97 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.506846 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdabc1-fe13-466e-aac4-759a7edcbc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.507420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdabc1-fe13-466e-aac4-759a7edcbc21 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.507707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdabc1-fe13-466e-aac4-759a7edcbc21 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.507983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdabc1-fe13-466e-aac4-759a7edcbc21 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.508717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdabc1-fe13-466e-aac4-759a7edcbc21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:01.509024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdabc1-fe13-466e-aac4-759a7edcbc21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.510973 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdabc1-fe13-466e-aac4-759a7edcbc21 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:01.527811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 369/742] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:01.527811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bf047-5d04-4e54-b3f8-3cb79a641be3 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.527811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bf047-5d04-4e54-b3f8-3cb79a641be3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.527811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bf047-5d04-4e54-b3f8-3cb79a641be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.543315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-6e4bf047-5d04-4e54-b3f8-3cb79a641be3 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:01.544583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-6e4bf047-5d04-4e54-b3f8-3cb79a641be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:01.545675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b350f2-6c1b-432e-a9ff-ec9df241e735 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.568859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:01.583738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.584406 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.584694 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.584975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.585995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:01.586308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.587830 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:01.600833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 374/743] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:01.601755 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.622874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 370/744] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 13:37:01.623740 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bf047-5d04-4e54-b3f8-3cb79a641be3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.669341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:01.730949 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bf047-5d04-4e54-b3f8-3cb79a641be3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.732717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670ea8f-2c17-44ca-8396-d537bea68373 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.767468 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.768048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.768336 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.768610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.769361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:01.769669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.770459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.771105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:01.771573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.772008 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.772567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.779671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 375/745] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:01.780505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.787966 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.793013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:01.813125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:01.814414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:01.815645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:01.820042 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 371/746] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:01.820042 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.846421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:01.908243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c71f-6928-4aae-8e6f-ae4696bf4952 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.909848 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:01.936193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08894d-9cf4-4800-8625-14138b692c26 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:01.944623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.945423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.945711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.946029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.953590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.955100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:01.969541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:01.970808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:01.971953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 376/747] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:01.976288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:01.978063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d3c86-7e4f-4ba2-93cf-8ff23ecf0ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:01.979076 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3c86-7e4f-4ba2-93cf-8ff23ecf0ee8 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:01.979561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3c86-7e4f-4ba2-93cf-8ff23ecf0ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:01.980003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3c86-7e4f-4ba2-93cf-8ff23ecf0ee8 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:01.981005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d3c86-7e4f-4ba2-93cf-8ff23ecf0ee8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:01.982555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d3c86-7e4f-4ba2-93cf-8ff23ecf0ee8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.001453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 372/748] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:37:01 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:02.002636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d3c86-7e4f-4ba2-93cf-8ff23ecf0ee8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.112687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:02.113986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e4b4b-0b00-4b55-ac88-0ab1365db103 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.148324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d3c86-7e4f-4ba2-93cf-8ff23ecf0ee8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.166416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.167464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.167819 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.168177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.185327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.187335 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.190473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.191487 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.192031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.192484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.193522 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:02.194114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.195800 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:02.209638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:02.211427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:02.212582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:02.212582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:02.212582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:02.212582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:02.219993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 377/749] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:02.221228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.233979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 373/750] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:02.235229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.244880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:02.360329 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86267e-d823-4f9b-b732-251a729e87fe None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.378911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e15f-cb96-4e12-8d31-bc94bc57287d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.396428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.397101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.397387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.397656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.398415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:02.398720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.400085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.402467 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:02.418968 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 374/751] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:02.419942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.427588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.428387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.428738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.429080 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.430482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:02.430862 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.433301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.454423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 378/752] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:02.455468 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.528081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa99a-4615-4380-af18-5849a8c5f593 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.540159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:02.565095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.566212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.566212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.566503 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.573679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815efe-29e9-405a-af19-f089ce346390 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.579411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.580894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:02.599656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:02.600621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:02.601565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:02.601565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:02.601565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:02.601565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:02.601565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 375/753] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:02.602161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.616352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.617531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.618001 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.618513 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.627166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.628909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:02.644840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:02.646077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:02.647198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:02.649450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 379/754] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:02.651041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.662215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:02.711807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00577fe-3286-4dee-b908-ca5b7e3b3226 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.746857 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.747774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.747774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.748058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.748894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=c0b98559906540c082df06432223b497, user.id=a2759d80c45b46bda24dd9509ea089ac) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:02.749212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.750678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.756464 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 376/755] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/role_assignments?user.id=a2759d80c45b46bda24dd9509ea089ac&scope.project.id=c0b98559906540c082df06432223b497&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:02.757312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.762268 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f13e80-def5-401a-a93e-2c1095973c8f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.820764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a58f6-2301-4f20-8be7-6f6fd41af6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.822742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a58f6-2301-4f20-8be7-6f6fd41af6ab None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.823019 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a58f6-2301-4f20-8be7-6f6fd41af6ab None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.823382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a58f6-2301-4f20-8be7-6f6fd41af6ab None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.824671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a58f6-2301-4f20-8be7-6f6fd41af6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:02.825091 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a58f6-2301-4f20-8be7-6f6fd41af6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.827067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a58f6-2301-4f20-8be7-6f6fd41af6ab None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.829659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:02.845088 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 380/756] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:02.847716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78d28-76f3-44fd-a085-139ee465fad5 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.848214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78d28-76f3-44fd-a085-139ee465fad5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.848700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78d28-76f3-44fd-a085-139ee465fad5 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.853958 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 381/757] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:02.855132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78d28-76f3-44fd-a085-139ee465fad5 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:02.913522 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a497ac1-20d4-4ac3-97d6-eaccdc0079d1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:02.926283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:02.963669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0ec4d-aad9-4ac4-a107-6cc61c7ea5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:02.964358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0ec4d-aad9-4ac4-a107-6cc61c7ea5a6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.964645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0ec4d-aad9-4ac4-a107-6cc61c7ea5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.964925 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0ec4d-aad9-4ac4-a107-6cc61c7ea5a6 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:02.966393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0ec4d-aad9-4ac4-a107-6cc61c7ea5a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:02.966991 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0ec4d-aad9-4ac4-a107-6cc61c7ea5a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:02.968634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0ec4d-aad9-4ac4-a107-6cc61c7ea5a6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:02.993830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 377/758] 10.222.0.13 () {56 vars in 1149 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:02.995766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64016-298b-447a-bb2d-fc9552fd81c9 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:02.996057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64016-298b-447a-bb2d-fc9552fd81c9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:02.996383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64016-298b-447a-bb2d-fc9552fd81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.014450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78d28-76f3-44fd-a085-139ee465fad5 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:03.021329 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-aaa64016-298b-447a-bb2d-fc9552fd81c9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:03.022797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-aaa64016-298b-447a-bb2d-fc9552fd81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:03.051844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:03.052649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:03.052935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:03.053213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.061453 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:03.063056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:03.078105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:03.079064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:03.079994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 382/759] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:03.080950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.118468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 378/760] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:03.121159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa64016-298b-447a-bb2d-fc9552fd81c9 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.149999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:03.212597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db423e-fde0-4861-84ce-0036ec6990f0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:03.242121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:03.250302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa64016-298b-447a-bb2d-fc9552fd81c9 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:03.255280 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568495e-aad4-4123-8c86-aeeb36deb463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:03.256101 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568495e-aad4-4123-8c86-aeeb36deb463 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:03.256654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568495e-aad4-4123-8c86-aeeb36deb463 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:03.257041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568495e-aad4-4123-8c86-aeeb36deb463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.296414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:03.297087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:03.297373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:03.297647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.298468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:03.298775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:03.300214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:03.313193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 379/761] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:03.314162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.350793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568495e-aad4-4123-8c86-aeeb36deb463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:03.352285 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568495e-aad4-4123-8c86-aeeb36deb463 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:03.411100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:03.439562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25baa7-d78f-40f0-8914-dde074041eda None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:03.465919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 383/762] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:37:03.467123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568495e-aad4-4123-8c86-aeeb36deb463 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.480833 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:03.482030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:03.482274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:03.482553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.483390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:03.485091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:03.501164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:03.502376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:03.503725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 380/763] 10.222.0.13 () {56 vars in 1129 bytes} [Wed May 25 13:37:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:03.504583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.546198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:03.581305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568495e-aad4-4123-8c86-aeeb36deb463 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:03.617772 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb68208-d9a5-40f0-948c-f3f5d9d54fa3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:03.619130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb77a-687d-4ca6-b4e2-56306d0c3840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:03.620225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb77a-687d-4ca6-b4e2-56306d0c3840 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:03.620652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb77a-687d-4ca6-b4e2-56306d0c3840 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:03.621287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb77a-687d-4ca6-b4e2-56306d0c3840 None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/7ac29fbb131c4ccf9ee7f26c4bd6523c/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.623627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdb77a-687d-4ca6-b4e2-56306d0c3840 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=7ac29fbb131c4ccf9ee7f26c4bd6523c, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:03.625273 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdb77a-687d-4ca6-b4e2-56306d0c3840 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:03.640445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 384/764] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:37:03 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/7ac29fbb131c4ccf9ee7f26c4bd6523c/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:37:03.641660 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb77a-687d-4ca6-b4e2-56306d0c3840 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.655489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:03.656390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:03.656759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:03.657092 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.662285 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:03.670039 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:03.671688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:03.691428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:03.692729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:03.694231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:03.694231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:03.694231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:03.694231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:03.694231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 381/765] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:03.698327 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.823575 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb77a-687d-4ca6-b4e2-56306d0c3840 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:03.836321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:03.877908 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:03.878596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:03.878932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:03.879221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.879943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:03.880257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:03.882429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:03.888965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 385/766] 10.222.0.13 () {56 vars in 1124 bytes} [Wed May 25 13:37:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:03.895200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.911163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623af26-d8eb-497d-94d2-f3b7c70ba7b6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:03.950134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18e75-875e-47be-9847-768a841520bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:03.950917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18e75-875e-47be-9847-768a841520bd None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:03.951205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18e75-875e-47be-9847-768a841520bd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:03.951483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18e75-875e-47be-9847-768a841520bd None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:03.952215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d18e75-875e-47be-9847-768a841520bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:03.952524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d18e75-875e-47be-9847-768a841520bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:03.954031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d18e75-875e-47be-9847-768a841520bd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:03.973197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 382/767] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:03.974517 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18e75-875e-47be-9847-768a841520bd None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:03.991806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:04.016430 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e61d36-5eec-4ab9-9dd7-249b0cd464ad None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:04.054868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:04.055916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:04.056206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:04.056532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:04.057397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:04.057941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:04.059647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:04.066632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 386/768] 10.222.0.13 () {56 vars in 1124 bytes} [Wed May 25 13:37:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:04.073034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:04.122499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18e75-875e-47be-9847-768a841520bd None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:04.164520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:04.165716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:04.167077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:04.168348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:04.171998 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:04.183561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:04.187994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:04.213514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:04.214726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:04.215860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:04.215860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:04.215860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:04.215860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:04.215860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:04.215860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:04.215860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:04.215860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:04.226349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 383/769] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:04.234162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:04.308463 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce60911-de84-4ad3-9855-887b3c4783bc None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:04.345204 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086c9ff-f228-4ef0-9169-9177e42b5b05 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:04.382186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:04.383256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:04.383762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:04.384238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:04.385843 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] RBAC: Adding query filter params (interface=public, service_id=b5b73ecf5a1a4359a916c608f647fd5c, region_id=RegionOne) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:04.386361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:04.387946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:04.402200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:04.402200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:04.402200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:04.402200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:04.402632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:04.402632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:04.402632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:04.406644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 387/770] 10.222.0.13 () {56 vars in 1251 bytes} [Wed May 25 13:37:04 2022] GET /identity/v3/endpoints?service_id=b5b73ecf5a1a4359a916c608f647fd5c&interface=public®ion_id=RegionOne => generated 194 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:04.411571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 384/771] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:04.417532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:04.418822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:04.439772 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:04.494796 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:04.546621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faade537-0345-454b-87d0-92ffa58b1833 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:04.584985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216142f7-29a5-43d2-96d5-b6873b25e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:04.586287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216142f7-29a5-43d2-96d5-b6873b25e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:04.586812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216142f7-29a5-43d2-96d5-b6873b25e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:04.587369 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216142f7-29a5-43d2-96d5-b6873b25e4a3 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:04.588356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216142f7-29a5-43d2-96d5-b6873b25e4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:04.589963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216142f7-29a5-43d2-96d5-b6873b25e4a3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:04.596288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 385/772] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:37:04 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:04.616647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb22890-7845-4e7c-8fcd-d1585d826aad None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:04.656170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623033d2-3e84-4154-8ed6-a0f4411aeef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:04.656851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623033d2-3e84-4154-8ed6-a0f4411aeef4 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:04.657137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623033d2-3e84-4154-8ed6-a0f4411aeef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:04.657417 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623033d2-3e84-4154-8ed6-a0f4411aeef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:04.658302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623033d2-3e84-4154-8ed6-a0f4411aeef4 None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=cd2f4a2f2f06432b9c9352ac707a6527) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:04.658621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623033d2-3e84-4154-8ed6-a0f4411aeef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:04.660132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623033d2-3e84-4154-8ed6-a0f4411aeef4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:04.667709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 388/773] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:04 2022] GET /identity/v3/role_assignments?user.id=cd2f4a2f2f06432b9c9352ac707a6527&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:04.767135 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8cdb2-57c6-4a08-99d5-70a9071ca8f3 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:04.767489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8cdb2-57c6-4a08-99d5-70a9071ca8f3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:04.767703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8cdb2-57c6-4a08-99d5-70a9071ca8f3 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:04.769417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 386/774] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:04.775227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1592-7c2d-496c-8f67-072a290f5411 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:04.775521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1592-7c2d-496c-8f67-072a290f5411 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:04.775809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1592-7c2d-496c-8f67-072a290f5411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:04.802875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-8c0c1592-7c2d-496c-8f67-072a290f5411 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:04.804115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-8c0c1592-7c2d-496c-8f67-072a290f5411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:04.914403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:04.922219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 389/775] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:04.943880 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8cdb2-57c6-4a08-99d5-70a9071ca8f3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:05.069581 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8cdb2-57c6-4a08-99d5-70a9071ca8f3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:05.089470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:05.117486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62cce1-a7bc-43ff-98a4-f91d79e84c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:05.118333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62cce1-a7bc-43ff-98a4-f91d79e84c22 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:05.118736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62cce1-a7bc-43ff-98a4-f91d79e84c22 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:05.119543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62cce1-a7bc-43ff-98a4-f91d79e84c22 None admin] PATH_INFO: `/v3/services/network` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:05.120213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62cce1-a7bc-43ff-98a4-f91d79e84c22 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:05.121688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62cce1-a7bc-43ff-98a4-f91d79e84c22 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4e62cce1-a7bc-43ff-98a4-f91d79e84c22 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:05.138184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:05.139274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:05.140133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 387/776] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:04 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:05.147586 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1592-7c2d-496c-8f67-072a290f5411 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:05.233228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ce67e-5f8b-41b3-8340-346d40dae6a5 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:05.233848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ce67e-5f8b-41b3-8340-346d40dae6a5 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:05.234282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ce67e-5f8b-41b3-8340-346d40dae6a5 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:05.236100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 388/777] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:05.242228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc938-b266-4918-a776-b50840aa278d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:05.245893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc938-b266-4918-a776-b50840aa278d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:05.246398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc938-b266-4918-a776-b50840aa278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:05.275962 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-552bc938-b266-4918-a776-b50840aa278d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:05.277351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-552bc938-b266-4918-a776-b50840aa278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:05.341414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1592-7c2d-496c-8f67-072a290f5411 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:05.406899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:05.407913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:05.408708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:05.409675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:05.411216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] RBAC: Adding query filter params (name=network) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:05.412103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 389/778] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:05.412727 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:05.414473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:05.420538 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 390/779] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:05.425768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bc938-b266-4918-a776-b50840aa278d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:05.460531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:05.581178 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:05.596559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bc938-b266-4918-a776-b50840aa278d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:05.611557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:05.645460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc00cea-c4da-4932-b238-34fdb171cbbc None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:05.656920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:05.657607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:05.657922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:05.658199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:05.658922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:05.659233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:05.660612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:05.670122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 390/780] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:05.675294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:05.721076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c0b4a-5d11-4043-ab8d-184000e19895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:05.721927 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0b4a-5d11-4043-ab8d-184000e19895 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:05.722214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0b4a-5d11-4043-ab8d-184000e19895 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:05.722505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0b4a-5d11-4043-ab8d-184000e19895 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:05.745010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c0b4a-5d11-4043-ab8d-184000e19895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-847c0b4a-5d11-4043-ab8d-184000e19895 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:05.752667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:05.753609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:05.754504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:05.756508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 391/781] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:05.763749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c0b4a-5d11-4043-ab8d-184000e19895 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:05.850297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945234-f4ad-461d-a34a-6ce15757e5b5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:05.886855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:05.887658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:05.887948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:05.888228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:05.889027 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] RBAC: Adding query filter params (interface=public, service_id=70beefc57ff64e7793b2bd6239cc6764, region_id=RegionOne) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:05.889348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:05.890904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:05.899807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 391/782] 10.222.0.13 () {56 vars in 1251 bytes} [Wed May 25 13:37:05 2022] GET /identity/v3/endpoints?service_id=70beefc57ff64e7793b2bd6239cc6764&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:05.905634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:05.963570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c0b4a-5d11-4043-ab8d-184000e19895 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:05.982528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:05.989640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:06.001841 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:06.002545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.002836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.003123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.004022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:06.004252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:06.006103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:06.015967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 392/783] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:06.021260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:06.111806 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ff43b-3888-4bb8-bacc-e9221463bab7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:06.136729 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e6b4-ea50-4e60-9e7c-863aa45f8717 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:06.174998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:06.175811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.176097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.176376 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.189558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:06.191118 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:06.205933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6edd8-6f4b-4225-a368-072c0e88b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:06.206628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6edd8-6f4b-4225-a368-072c0e88b50b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.206924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6edd8-6f4b-4225-a368-072c0e88b50b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.207208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6edd8-6f4b-4225-a368-072c0e88b50b None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.207941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6edd8-6f4b-4225-a368-072c0e88b50b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:06.209434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6edd8-6f4b-4225-a368-072c0e88b50b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:06.213504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:06.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:06.216038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:06.216038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:06.216038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:06.216038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:06.216038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 393/784] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:06.220666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:06.224379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 392/785] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:37:05 2022] GET /identity/v3/services => generated 772 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:06.281334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:06.350370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ddbdf-5890-4bbb-9edb-8399688d9adf None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:06.391732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c8cf6-6527-4430-b6cf-1b85d294c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:06.392356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8cf6-6527-4430-b6cf-1b85d294c343 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.392643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8cf6-6527-4430-b6cf-1b85d294c343 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.392926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8cf6-6527-4430-b6cf-1b85d294c343 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.393692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c8cf6-6527-4430-b6cf-1b85d294c343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:06.394032 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c8cf6-6527-4430-b6cf-1b85d294c343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:06.395469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c8cf6-6527-4430-b6cf-1b85d294c343 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:06.409880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 394/786] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:06.418892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6edd8-6f4b-4225-a368-072c0e88b50b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:06.424951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929af4c-1c5a-4aaa-a4af-6f74764baec9 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.425273 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929af4c-1c5a-4aaa-a4af-6f74764baec9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.425572 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929af4c-1c5a-4aaa-a4af-6f74764baec9 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.428501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 395/787] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:06.435469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc89ae-67e4-43d9-afe9-b8930f8c39a9 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.435767 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc89ae-67e4-43d9-afe9-b8930f8c39a9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.436036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc89ae-67e4-43d9-afe9-b8930f8c39a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.457236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-e8cc89ae-67e4-43d9-afe9-b8930f8c39a9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:06.458687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e8cc89ae-67e4-43d9-afe9-b8930f8c39a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:06.545141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 396/788] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:06.569771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc89ae-67e4-43d9-afe9-b8930f8c39a9 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:06.597357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6edd8-6f4b-4225-a368-072c0e88b50b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:06.599328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:06.600615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:06.637979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:06.638785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.639174 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.639464 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.647841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:06.649348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:06.673320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:06.674375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:37:06.675325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:06.676344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 393/789] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:06.681868 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:06.686968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc89ae-67e4-43d9-afe9-b8930f8c39a9 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:06.755199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07507fd9-f46f-4bcc-b8ee-4ac3b02ff059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:06.756011 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507fd9-f46f-4bcc-b8ee-4ac3b02ff059 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.756301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507fd9-f46f-4bcc-b8ee-4ac3b02ff059 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.756583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507fd9-f46f-4bcc-b8ee-4ac3b02ff059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.780045 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07507fd9-f46f-4bcc-b8ee-4ac3b02ff059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-07507fd9-f46f-4bcc-b8ee-4ac3b02ff059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:06.788979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:06.791850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:06.793941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 397/790] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:06.801770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07507fd9-f46f-4bcc-b8ee-4ac3b02ff059 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:06.884836 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0bfc3-791a-4f1e-a383-078c8d7fe87f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:06.934025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:06.935012 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:06.935299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:06.935580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:06.936437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:06.936748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:06.938437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:06.970374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:06.977176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 394/791] 10.222.0.13 () {56 vars in 1135 bytes} [Wed May 25 13:37:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:06.987517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07507fd9-f46f-4bcc-b8ee-4ac3b02ff059 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:06.990872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:07.025599 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:07.026308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.026592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.026873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.027631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:07.027942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:07.029348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:07.043570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 398/792] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:07.049081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:07.052357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:07.217874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599232-3994-4005-9b1b-b87e729cefa9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:07.236897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0f56-cbea-4f3c-ad2f-ab358a804764 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:07.291880 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d37c7a-2bd2-4f99-9500-1fcdc8f37835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:07.293136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37c7a-2bd2-4f99-9500-1fcdc8f37835 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.294146 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37c7a-2bd2-4f99-9500-1fcdc8f37835 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.294950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37c7a-2bd2-4f99-9500-1fcdc8f37835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.300018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c18f2e-78f7-416b-93a9-39f1731d5005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:07.301073 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c18f2e-78f7-416b-93a9-39f1731d5005 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.301605 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c18f2e-78f7-416b-93a9-39f1731d5005 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.302988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c18f2e-78f7-416b-93a9-39f1731d5005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.313210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d37c7a-2bd2-4f99-9500-1fcdc8f37835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:07.314873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d37c7a-2bd2-4f99-9500-1fcdc8f37835 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:07.319885 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c18f2e-78f7-416b-93a9-39f1731d5005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:07.321533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c18f2e-78f7-416b-93a9-39f1731d5005 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-93d37c7a-2bd2-4f99-9500-1fcdc8f37835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:07.334393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:07.335541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:07.336896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:07.336896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:07.336896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:07.336896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:07.338738 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 395/793] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:07.340181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1861280-c9f8-48af-aea4-c3adaafdd293 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.340538 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1861280-c9f8-48af-aea4-c3adaafdd293 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.340884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1861280-c9f8-48af-aea4-c3adaafdd293 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-08c18f2e-78f7-416b-93a9-39f1731d5005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:07.343996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:07.344870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:07.345838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:07.345838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:07.345838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:07.345838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:07.346490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 396/794] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:07.347185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1861280-c9f8-48af-aea4-c3adaafdd293 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:07.348522 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 399/795] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:07.354964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e942-1769-4a61-bd4f-f319f666d57e None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.355991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e942-1769-4a61-bd4f-f319f666d57e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.356483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8e942-1769-4a61-bd4f-f319f666d57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.361935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:07.375850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-40b8e942-1769-4a61-bd4f-f319f666d57e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:07.377117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-40b8e942-1769-4a61-bd4f-f319f666d57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:07.445066 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:07.456513 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 400/796] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:07.457686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8e942-1769-4a61-bd4f-f319f666d57e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:07.489030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1861280-c9f8-48af-aea4-c3adaafdd293 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:07.531018 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d92c-8613-4046-9bf4-cc6f4e382418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:07.531700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d92c-8613-4046-9bf4-cc6f4e382418 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.531993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d92c-8613-4046-9bf4-cc6f4e382418 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.532278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d92c-8613-4046-9bf4-cc6f4e382418 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.533026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d92c-8613-4046-9bf4-cc6f4e382418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:07.533342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d92c-8613-4046-9bf4-cc6f4e382418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:07.534788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d92c-8613-4046-9bf4-cc6f4e382418 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:07.547841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 397/797] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:07.549210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78500e-9193-4dc6-9d1b-9e42d56633a6 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.549510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78500e-9193-4dc6-9d1b-9e42d56633a6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.549827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78500e-9193-4dc6-9d1b-9e42d56633a6 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.553856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 398/798] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:07.553856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78500e-9193-4dc6-9d1b-9e42d56633a6 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:07.597204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8e942-1769-4a61-bd4f-f319f666d57e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:07.631230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:07.637589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:07.637589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.638013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.638215 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.638955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:07.639473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:07.641166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:07.653497 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 401/799] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:07.654387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:07.684882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78500e-9193-4dc6-9d1b-9e42d56633a6 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:07.726178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff8cf3-8188-40f2-ab8a-09a3401ebe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:07.727168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8cf3-8188-40f2-ab8a-09a3401ebe80 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.727459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8cf3-8188-40f2-ab8a-09a3401ebe80 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.727742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8cf3-8188-40f2-ab8a-09a3401ebe80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.729848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:07.741368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff8cf3-8188-40f2-ab8a-09a3401ebe80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-73ff8cf3-8188-40f2-ab8a-09a3401ebe80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:07.749048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:07.750148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 399/800] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:37:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:07.756045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703a1d-b327-43b9-8da5-c4dd5bffbfe9 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.756856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703a1d-b327-43b9-8da5-c4dd5bffbfe9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.756856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703a1d-b327-43b9-8da5-c4dd5bffbfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.776886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-75703a1d-b327-43b9-8da5-c4dd5bffbfe9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:07.778307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-75703a1d-b327-43b9-8da5-c4dd5bffbfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:07.780967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4bc33-b892-4ad6-8cfb-91b5eea97fde None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:07.822667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:07.823705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:07.824075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:07.824426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:07.831626 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:07.833091 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:07.848244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:07.849185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:07.850143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 402/801] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:07.850639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:07.865862 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 400/802] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:07.866743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703a1d-b327-43b9-8da5-c4dd5bffbfe9 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:07.918089 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:07.968158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f85af-2f5e-4e20-b92b-f17344d55343 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:07.973792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703a1d-b327-43b9-8da5-c4dd5bffbfe9 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:07.998822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:08.003293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.004094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.004378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.004652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.012109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.012780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.012886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.013082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.013349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.014138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:08.014314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.014469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.016057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.029128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 401/803] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:08.029128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:08.029687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:08.030674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:08.031632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 403/804] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:37:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:08.032230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.132815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a1813-fbfb-49e4-a36e-392e7fdfb709 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.136484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8631a-de41-49ca-ad11-bb73e2d83574 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.147150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:08.170562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.171642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.171773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.171973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.172218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.172393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.172658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.172875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.172970 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.173716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:08.174056 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.174311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.175470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.192714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 402/805] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:08.192714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:08.192971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:08.193859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:08.194732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 404/806] 10.222.0.13 () {56 vars in 1129 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:08.195579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.243324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:08.302356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d075a85-e31e-4cc0-bce3-f0dd313e2c61 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.303996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e471cb1-b529-43ad-ac8e-6d91d8ac696b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.340071 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.340304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.340871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.340978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.341161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.341259 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.341442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.341555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.342350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:08.342663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.344631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.351644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.353087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.363560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 405/807] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:08.364355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:08.376872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:08.377822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:08.378728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:08.378728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:08.378728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:08.378728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:08.380432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 403/808] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:08.381383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.405031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:08.475651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903226b1-c275-44ed-9ad1-5ee4d2de3d7b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.487070 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:08.491466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ba575-154f-4add-9be0-2f9a01e1935a None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.513907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc24f8-f559-4223-bfd0-42f68cc9f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.514982 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc24f8-f559-4223-bfd0-42f68cc9f663 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.515274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc24f8-f559-4223-bfd0-42f68cc9f663 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.515556 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc24f8-f559-4223-bfd0-42f68cc9f663 None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/a2759d80c45b46bda24dd9509ea089ac/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.517657 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc24f8-f559-4223-bfd0-42f68cc9f663 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=a2759d80c45b46bda24dd9509ea089ac, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.519246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc24f8-f559-4223-bfd0-42f68cc9f663 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.528647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.529315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.529606 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.529919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.530626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:08.530938 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.532297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.534816 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 406/809] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:37:08 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/a2759d80c45b46bda24dd9509ea089ac/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:37:08.535823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc24f8-f559-4223-bfd0-42f68cc9f663 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.548659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 404/810] 10.222.0.13 () {56 vars in 1124 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:08.550001 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.659507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:08.669982 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc24f8-f559-4223-bfd0-42f68cc9f663 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.687367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5baf2-027b-41b4-b473-063d7c19a777 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.714115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66687fe2-4120-4b2f-914e-5cab9d83a42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.714951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66687fe2-4120-4b2f-914e-5cab9d83a42e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.715243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66687fe2-4120-4b2f-914e-5cab9d83a42e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.715524 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66687fe2-4120-4b2f-914e-5cab9d83a42e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.739989 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.741686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.742241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.743025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.744340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:08.745320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.747611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.764122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 405/811] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:08.765713 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.799627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:08.800923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66687fe2-4120-4b2f-914e-5cab9d83a42e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.802441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66687fe2-4120-4b2f-914e-5cab9d83a42e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.888470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f728d-779b-42e2-aea6-6d77eca4d525 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:08.922388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:08.924342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08612c47-132b-406f-9831-4724484107bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:08.925016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612c47-132b-406f-9831-4724484107bc None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.925327 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612c47-132b-406f-9831-4724484107bc None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.925578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612c47-132b-406f-9831-4724484107bc None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.926321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612c47-132b-406f-9831-4724484107bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:08.926631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612c47-132b-406f-9831-4724484107bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:08.928069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612c47-132b-406f-9831-4724484107bc None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:08.931144 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 407/812] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:37:08.931801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66687fe2-4120-4b2f-914e-5cab9d83a42e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:08.941814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 406/813] 10.222.0.13 () {56 vars in 1124 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:08.941814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b31b7-d50d-4c00-b96e-38de07cf2baf None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:08.941814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b31b7-d50d-4c00-b96e-38de07cf2baf None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:08.941814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b31b7-d50d-4c00-b96e-38de07cf2baf None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:08.941814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 407/814] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:08.941814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b31b7-d50d-4c00-b96e-38de07cf2baf None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.034787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:09.044056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66687fe2-4120-4b2f-914e-5cab9d83a42e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.051886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b31b7-d50d-4c00-b96e-38de07cf2baf None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.080248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.081058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.081347 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.081626 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.087022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50557615-b917-433f-9d46-f390c7a5a841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.088443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557615-b917-433f-9d46-f390c7a5a841 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.088733 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557615-b917-433f-9d46-f390c7a5a841 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.089011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557615-b917-433f-9d46-f390c7a5a841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.090043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.091562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.101694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50557615-b917-433f-9d46-f390c7a5a841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.103189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50557615-b917-433f-9d46-f390c7a5a841 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:09.108736 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:09.109910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:09.111237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 408/815] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:09.111964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-50557615-b917-433f-9d46-f390c7a5a841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:09.128276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:09.129413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:09.130472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:09.130472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:09.130472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:09.130472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:09.130716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 408/816] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:09.132345 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503cbb-8d6e-4b28-9db5-7cc060035f29 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.132640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503cbb-8d6e-4b28-9db5-7cc060035f29 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.132916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503cbb-8d6e-4b28-9db5-7cc060035f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.151083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-20503cbb-8d6e-4b28-9db5-7cc060035f29 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:09.152263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-20503cbb-8d6e-4b28-9db5-7cc060035f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:09.173200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:09.223200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9da281-e5d2-4161-9d38-c4f155d80e41 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.223798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 409/817] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:09.224628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20503cbb-8d6e-4b28-9db5-7cc060035f29 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.271591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab061-910f-42e0-acd7-8064b2b4443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.272399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab061-910f-42e0-acd7-8064b2b4443b None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.272784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab061-910f-42e0-acd7-8064b2b4443b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.273167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab061-910f-42e0-acd7-8064b2b4443b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.274038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ab061-910f-42e0-acd7-8064b2b4443b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.276061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ab061-910f-42e0-acd7-8064b2b4443b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.295352 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:09.296797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 409/818] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:37:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:09.297615 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab061-910f-42e0-acd7-8064b2b4443b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.352600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20503cbb-8d6e-4b28-9db5-7cc060035f29 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.405655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.406939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.407379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.408217 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.409257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:09.409760 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.412073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.425374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab061-910f-42e0-acd7-8064b2b4443b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.438905 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:09.444842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 410/819] 10.222.0.13 () {56 vars in 1149 bytes} [Wed May 25 13:37:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:09.444842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.478877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.480262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.480708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.481380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.482307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:09.482794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.485362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.501446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 410/820] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:09.502569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.560912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac37872-a38d-4698-8100-3ede88423c2b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.591714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:09.604040 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.605337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.606066 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.606727 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] PATH_INFO: `/v3/services/network` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.607322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.609036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.620410 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4d061-43c1-4df3-bb8f-e046b505a2bf None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:09.622734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:09.624080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 13:37:09.625194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:09.627419 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 411/821] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:09 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:09.628380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.663199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.664350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.664851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.665280 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.677494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.679228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:09.699800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:09.700888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:09.702029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:09.702029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:09.702029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:09.702029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:09.703999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 411/822] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:09.705048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.734265 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:09.738639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ecc13-460c-4e9e-a979-32f01bed5974 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.776609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.777680 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.778165 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.778541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.786000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.787655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:09.811391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:09.812541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:09.813666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:09.813666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:09.813666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:09.813666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:09.813666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:09.813666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:09.813666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:09.813666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:09.819945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 412/823] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:09.819945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.828557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310b12-d111-46bc-8ed7-574f1461bb9f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.866117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.867171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:09.867818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.868244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.868702 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.870127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:09.870675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.872214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.878028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 412/824] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:09.879210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:09.930507 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32739a9-ab25-4100-9b12-f33a7372c955 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:09.977496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:09.979194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:09.979660 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:09.980343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:09.981322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:09.982399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:09.982864 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:09.984395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:09.999435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2d446-7cdb-43d9-b39b-c007dae455a7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:10.002785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 413/825] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:10.003768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:10.037401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:10.038235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.038618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.038996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.039882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:10.040302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:10.042477 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:10.060524 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 413/826] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:10.060524 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:10.141471 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fb521-fa13-486e-9a3d-0aa3842226e6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:10.149278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:10.165206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f468e-037a-4970-a704-1fea3bf19d52 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:10.181211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:10.182176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.182613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.183035 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.183999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] RBAC: Adding query filter params (type=network) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:10.184465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:10.186115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:10.192093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 414/827] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:10.193132 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:10.202680 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:10.203559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.203916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.204266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.211731 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:10.213874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:10.229289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:10.230262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:10.231214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 414/828] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:10.231992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:10.241801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:10.309257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67e753-f6fa-4683-9efa-dbd668ed3fb6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:10.338256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ed9b-291d-45b1-aab5-0b8fe46b0609 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:10.348564 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:10.349440 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.350003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.350469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.351481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=c0b98559906540c082df06432223b497, user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:10.351976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:10.354479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:10.370149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 415/829] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:10 2022] GET /identity/v3/role_assignments?user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c&scope.project.id=c0b98559906540c082df06432223b497&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:10.371478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:10.375112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d2641-2cfe-4ce7-9a04-3c186f82db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:10.376416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d2641-2cfe-4ce7-9a04-3c186f82db50 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.376416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d2641-2cfe-4ce7-9a04-3c186f82db50 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.376416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d2641-2cfe-4ce7-9a04-3c186f82db50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.377271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d2641-2cfe-4ce7-9a04-3c186f82db50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:10.378782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d2641-2cfe-4ce7-9a04-3c186f82db50 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:10.411833 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:10.423912 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 415/830] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:37:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:10.494560 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced3b1-690b-40bb-bc42-6231e81f1eeb None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:10.547276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca584df3-f536-41e8-9f80-4134f08d4fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:10.548351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca584df3-f536-41e8-9f80-4134f08d4fa9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.548868 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca584df3-f536-41e8-9f80-4134f08d4fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.549376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca584df3-f536-41e8-9f80-4134f08d4fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.550447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca584df3-f536-41e8-9f80-4134f08d4fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:10.550978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca584df3-f536-41e8-9f80-4134f08d4fa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:10.552672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca584df3-f536-41e8-9f80-4134f08d4fa9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:10.572357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 416/831] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:10.578360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d2641-2cfe-4ce7-9a04-3c186f82db50 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:10.686304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:10.734285 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d2641-2cfe-4ce7-9a04-3c186f82db50 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:10.770271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09062b-ae30-4fc4-a5ec-1ec2d833929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:10.771081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09062b-ae30-4fc4-a5ec-1ec2d833929d None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.771366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09062b-ae30-4fc4-a5ec-1ec2d833929d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.771645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09062b-ae30-4fc4-a5ec-1ec2d833929d None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/cd2f4a2f2f06432b9c9352ac707a6527/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.790125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09062b-ae30-4fc4-a5ec-1ec2d833929d None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=cd2f4a2f2f06432b9c9352ac707a6527, role_id=8cb69f0fee6a4e7295d8a8bc1aff8d03)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:10.791654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09062b-ae30-4fc4-a5ec-1ec2d833929d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:10.809787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 416/832] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:37:10 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/cd2f4a2f2f06432b9c9352ac707a6527/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:37:10.902313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768bada-0d85-4bf5-8da5-227e9e875d73 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.902839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768bada-0d85-4bf5-8da5-227e9e875d73 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.902933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768bada-0d85-4bf5-8da5-227e9e875d73 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.904574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 417/833] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:10.910872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fb004-2f55-4946-ab08-3a87ef45c67f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:10.911154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fb004-2f55-4946-ab08-3a87ef45c67f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:10.911443 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fb004-2f55-4946-ab08-3a87ef45c67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:10.929509 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-844fb004-2f55-4946-ab08-3a87ef45c67f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:10.930767 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-844fb004-2f55-4946-ab08-3a87ef45c67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:11.010191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 417/834] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:11.029022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768bada-0d85-4bf5-8da5-227e9e875d73 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:11.124739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:11.136681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768bada-0d85-4bf5-8da5-227e9e875d73 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:11.170790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd21870-67b5-410c-88a6-50bde753f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:11.171592 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd21870-67b5-410c-88a6-50bde753f409 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:11.171875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd21870-67b5-410c-88a6-50bde753f409 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:11.172153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd21870-67b5-410c-88a6-50bde753f409 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:11.183148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd21870-67b5-410c-88a6-50bde753f409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-bcd21870-67b5-410c-88a6-50bde753f409 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:11.191080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:11.192020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:11.192865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:11.197842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 418/835] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:11.199195 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fb004-2f55-4946-ab08-3a87ef45c67f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:11.247545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:11.310157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fb004-2f55-4946-ab08-3a87ef45c67f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:11.347965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:11.348651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:11.348941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:11.349225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:11.350009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:11.350325 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:11.351723 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:11.361382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 418/836] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:11.367429 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd21870-67b5-410c-88a6-50bde753f409 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:11.470267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd21870-67b5-410c-88a6-50bde753f409 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:11.505590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:11.506421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:11.506711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:11.506987 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:11.521994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:11.523447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:11.540392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:11.541832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:11.543798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:11.543798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:11.543798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:11.543798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:11.543798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 419/837] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:11.547719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:11.662966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35285b-767c-490f-9d3b-a419a84daa00 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:11.665310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:11.699215 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d6222-9c35-4c95-800f-b12732b20e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:11.699899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d6222-9c35-4c95-800f-b12732b20e37 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:11.700190 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d6222-9c35-4c95-800f-b12732b20e37 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:11.700475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d6222-9c35-4c95-800f-b12732b20e37 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:11.701205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d6222-9c35-4c95-800f-b12732b20e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:11.701518 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d6222-9c35-4c95-800f-b12732b20e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:11.702950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d6222-9c35-4c95-800f-b12732b20e37 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:11.716127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 419/838] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:11.721749 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:11.726019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:11.821335 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b479060-7e59-436b-bd3d-93495a1da61e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:11.821632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b479060-7e59-436b-bd3d-93495a1da61e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:11.821982 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b479060-7e59-436b-bd3d-93495a1da61e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:11.823508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 420/839] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:11.828754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb980e-b7cd-4696-a6e5-09613f86a195 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:11.829155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb980e-b7cd-4696-a6e5-09613f86a195 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:11.829540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb980e-b7cd-4696-a6e5-09613f86a195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:11.848167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-3bdb980e-b7cd-4696-a6e5-09613f86a195 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:11.849486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-3bdb980e-b7cd-4696-a6e5-09613f86a195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:11.851186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525f791-46f0-44e8-9e70-ce7ecf9a7ced None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:11.896308 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:11.897642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:11.898109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:11.898812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:11.909667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:11.912417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:11.929814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:11.930822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 13:37:11.931827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:11.932434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 421/840] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:11.934582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 420/841] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:11.940324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb980e-b7cd-4696-a6e5-09613f86a195 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:11.946284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:12.033029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:12.046579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:12.056499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb980e-b7cd-4696-a6e5-09613f86a195 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:12.091977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600ccc0-e633-4abc-9bf3-92b0a03d3258 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:12.092921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:12.093666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.094075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.094525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.095311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:12.096380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:12.097202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:12.119620 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 422/842] 10.222.0.13 () {56 vars in 1135 bytes} [Wed May 25 13:37:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:12.121241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:12.140449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:12.141885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.142449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.142933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.144279 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:12.146357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:12.164252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:12.165371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:12.166321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:12.169815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 421/843] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:12.174469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:12.233213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d14354-5734-4bb4-8947-1abeb9564a48 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:12.269262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c345d0-a8a6-4c57-bc01-f9041c6682c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:12.270110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c345d0-a8a6-4c57-bc01-f9041c6682c9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.270582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c345d0-a8a6-4c57-bc01-f9041c6682c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.270866 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c345d0-a8a6-4c57-bc01-f9041c6682c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.291253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06ebe9-055a-4130-a348-51e79030c1f2 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:12.294811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:12.318363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:12.329608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:12.330601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.331112 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.331609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.332538 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:12.333068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:12.334659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:12.345364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 422/844] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:12.347433 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c345d0-a8a6-4c57-bc01-f9041c6682c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:12.347935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:12.348933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c345d0-a8a6-4c57-bc01-f9041c6682c9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:12.458350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 423/845] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:37:12.459753 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c9b78-f448-416c-bcaa-dafd6b56f9f1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:12.463562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c345d0-a8a6-4c57-bc01-f9041c6682c9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:12.506003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:12.506595 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.506883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.507201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.507920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:12.508230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:12.511425 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:12.521596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 423/846] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:12.533880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:12.592076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c345d0-a8a6-4c57-bc01-f9041c6682c9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:12.635472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:12.636692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.637202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.637689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.650379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:12.652229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:12.672435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:12.674168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:12.675092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:12.675092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:12.675092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:12.675092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:12.677371 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 424/847] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:12.683958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:12.747953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:12.812310 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94946f6d-3ed7-41f6-bd22-707c4849e61b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:12.848313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035553a-8e26-45a7-b596-536da1fa055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:12.849337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035553a-8e26-45a7-b596-536da1fa055f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.849860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035553a-8e26-45a7-b596-536da1fa055f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.850364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035553a-8e26-45a7-b596-536da1fa055f None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.851294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035553a-8e26-45a7-b596-536da1fa055f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:12.851799 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035553a-8e26-45a7-b596-536da1fa055f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:12.853902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035553a-8e26-45a7-b596-536da1fa055f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:12.866774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 424/848] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:12.873123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:12.949098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35006b7b-f975-4c82-a5da-d62708279c14 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.949616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35006b7b-f975-4c82-a5da-d62708279c14 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.949694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35006b7b-f975-4c82-a5da-d62708279c14 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.951421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 425/849] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:12.959590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45dd5b-f00e-4895-ab44-957ea9a6b984 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:12.959590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45dd5b-f00e-4895-ab44-957ea9a6b984 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:12.959590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45dd5b-f00e-4895-ab44-957ea9a6b984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:12.979910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-cb45dd5b-f00e-4895-ab44-957ea9a6b984 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:12.982240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-cb45dd5b-f00e-4895-ab44-957ea9a6b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:12.992138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69207892-3343-4820-bf9d-0f03c1bddec1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:12.997231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:13.038524 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:13.039438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.039790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.040137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.049713 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:13.051473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:13.072441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:13.073420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:13.074382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 425/850] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:13.079366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:13.093956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 426/851] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:13.110691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45dd5b-f00e-4895-ab44-957ea9a6b984 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:13.165384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:13.190511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741df93d-7699-4b90-9117-430ee6a154fb None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:13.224036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45dd5b-f00e-4895-ab44-957ea9a6b984 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:13.226364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf7274-acd1-41cb-a4bf-e5773ebf8862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:13.227066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf7274-acd1-41cb-a4bf-e5773ebf8862 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.227360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf7274-acd1-41cb-a4bf-e5773ebf8862 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.227638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf7274-acd1-41cb-a4bf-e5773ebf8862 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.229067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf7274-acd1-41cb-a4bf-e5773ebf8862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:13.229381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf7274-acd1-41cb-a4bf-e5773ebf8862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:13.230861 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf7274-acd1-41cb-a4bf-e5773ebf8862 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:13.248644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 426/852] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:13.248644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7c1b-a0b4-4e7b-95ff-d459beb99910 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.248644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7c1b-a0b4-4e7b-95ff-d459beb99910 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.248644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7c1b-a0b4-4e7b-95ff-d459beb99910 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.250082 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 427/853] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:13.250662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b7c1b-a0b4-4e7b-95ff-d459beb99910 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:13.262771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497e53-d230-4f01-8aa9-024a20a59de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:13.263590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497e53-d230-4f01-8aa9-024a20a59de4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.263874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497e53-d230-4f01-8aa9-024a20a59de4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.264149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497e53-d230-4f01-8aa9-024a20a59de4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.264813 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53497e53-d230-4f01-8aa9-024a20a59de4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:13.266219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53497e53-d230-4f01-8aa9-024a20a59de4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:13.278855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-53497e53-d230-4f01-8aa9-024a20a59de4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:13.278992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:13.279898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:13.280739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 427/854] 10.222.0.13 () {56 vars in 1132 bytes} [Wed May 25 13:37:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:13.281627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819a5a-233b-4e4b-a608-02e454092ef7 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.281627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819a5a-233b-4e4b-a608-02e454092ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.282448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819a5a-233b-4e4b-a608-02e454092ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.301302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-00819a5a-233b-4e4b-a608-02e454092ef7 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:13.302546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-00819a5a-233b-4e4b-a608-02e454092ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:13.373909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b7c1b-a0b4-4e7b-95ff-d459beb99910 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:13.376810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 428/855] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:13.377328 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00819a5a-233b-4e4b-a608-02e454092ef7 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:13.418614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:13.427785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:13.428748 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.429255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.429614 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.430494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=c0b98559906540c082df06432223b497, user.id=a2759d80c45b46bda24dd9509ea089ac) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:13.430818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:13.432625 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:13.439295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 428/856] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:13 2022] GET /identity/v3/role_assignments?user.id=a2759d80c45b46bda24dd9509ea089ac&scope.project.id=c0b98559906540c082df06432223b497&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:13.439973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:13.514635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00819a5a-233b-4e4b-a608-02e454092ef7 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:13.546283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:13.565101 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749de331-4642-44da-b16c-8781bfbe2f11 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:13.572647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:13.574372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.574898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.575371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.576817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:13.577806 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:13.579739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:13.588470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 429/857] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:13.594514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:13.615117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79e41a-169a-469e-9cb2-faf84fa2171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:13.616564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79e41a-169a-469e-9cb2-faf84fa2171e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.617469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79e41a-169a-469e-9cb2-faf84fa2171e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.618032 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79e41a-169a-469e-9cb2-faf84fa2171e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.633386 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79e41a-169a-469e-9cb2-faf84fa2171e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-cc79e41a-169a-469e-9cb2-faf84fa2171e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:13.643714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:13.644717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:13.645590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 429/858] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:37:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:13.654786 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79e41a-169a-469e-9cb2-faf84fa2171e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:13.716609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c2cd3-2d49-4efe-bfa7-31d904d67b2b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:13.718606 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:13.756368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:13.757041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.757330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.757615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.758369 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:13.758687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:13.760722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:13.765993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 430/859] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:13.791842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79e41a-169a-469e-9cb2-faf84fa2171e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:13.832942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:13.833605 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:13.833935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:13.834223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:13.835001 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:13.835318 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:13.837168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:13.847657 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 430/860] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:37:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:13.853847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:13.973106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27619c1-f40c-4c29-b0ce-414180c8d39d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:14.013719 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:14.014904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:14.015452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:14.015941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:14.026918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:14.028685 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:14.046590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:14.047600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:14.048618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:14.048618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:14.048618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:14.048618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:14.050917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 431/861] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:14.057884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:14.074537 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:14.170415 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf4288-eb71-4689-880e-c2bafbdd6dd6 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:14.210136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:14.211056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:14.211340 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:14.211616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:14.212333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:14.212672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:14.214077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:14.226425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 431/862] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:14.231954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:14.251933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:14.343905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f249e-94ae-4c00-9dce-b6323b844ef6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:14.383122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:14.384234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:14.384234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:14.384525 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:14.392119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:14.393594 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:14.409415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:14.410481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:14.411449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 432/863] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:37:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:14.417232 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:14.495649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:14.529155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9dcc0-21bd-4df4-957d-91d1a8880b14 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:14.564968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaebd8b-00af-406b-b0bb-95b9cd75f085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:14.565636 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaebd8b-00af-406b-b0bb-95b9cd75f085 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:14.565960 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaebd8b-00af-406b-b0bb-95b9cd75f085 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:14.566241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaebd8b-00af-406b-b0bb-95b9cd75f085 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:14.567074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaebd8b-00af-406b-b0bb-95b9cd75f085 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:14.567388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaebd8b-00af-406b-b0bb-95b9cd75f085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:14.568836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaebd8b-00af-406b-b0bb-95b9cd75f085 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:14.587095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 432/864] 10.222.0.13 () {56 vars in 1149 bytes} [Wed May 25 13:37:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:14.592606 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:14.678134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:14.698841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f695-dd08-46ca-aca0-26b73ca034c7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:14.739128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c17e5-c6c2-4f6d-a28a-8d800f574517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:14.739849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c17e5-c6c2-4f6d-a28a-8d800f574517 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:14.740141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c17e5-c6c2-4f6d-a28a-8d800f574517 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:14.740424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c17e5-c6c2-4f6d-a28a-8d800f574517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:14.815389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c17e5-c6c2-4f6d-a28a-8d800f574517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:14.816858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c17e5-c6c2-4f6d-a28a-8d800f574517 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:14.896778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:14.916864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe671-46c8-44c8-9730-1a7971766f30 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:14.917401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe671-46c8-44c8-9730-1a7971766f30 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:14.917401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe671-46c8-44c8-9730-1a7971766f30 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:14.919069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 433/865] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:14.920005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 433/866] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:37:14.925204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af50b2-3076-4b0c-a886-0429b64c32a8 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:14.925569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af50b2-3076-4b0c-a886-0429b64c32a8 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:14.925950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af50b2-3076-4b0c-a886-0429b64c32a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:14.929351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c17e5-c6c2-4f6d-a28a-8d800f574517 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:14.944053 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-f7af50b2-3076-4b0c-a886-0429b64c32a8 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:14.945323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-f7af50b2-3076-4b0c-a886-0429b64c32a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:15.023514 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 434/867] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:15.044167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af50b2-3076-4b0c-a886-0429b64c32a8 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:15.054112 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c17e5-c6c2-4f6d-a28a-8d800f574517 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:15.090629 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:15.091821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:15.092327 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:15.092821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:15.104180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:15.105923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:15.124896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:15.126015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:15.126947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:15.126947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:15.126947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:15.126947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:15.129205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 434/868] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:15.130075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:15.134683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:15.156111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af50b2-3076-4b0c-a886-0429b64c32a8 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:15.170133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:15.195137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05af5-4a26-463a-aa60-9113625f5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:15.195811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05af5-4a26-463a-aa60-9113625f5405 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:15.196099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05af5-4a26-463a-aa60-9113625f5405 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:15.196378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05af5-4a26-463a-aa60-9113625f5405 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:15.197134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05af5-4a26-463a-aa60-9113625f5405 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:15.198651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05af5-4a26-463a-aa60-9113625f5405 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:15.221769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 435/869] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:37:15 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:37:15.256365 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccca39d-252e-4ab3-a676-0fd68f2196b4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:15.304263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:15.304891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:15.305239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:15.305574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:15.306897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:15.307269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:15.308687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:15.322591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 435/870] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:15.328280 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05af5-4a26-463a-aa60-9113625f5405 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:15.446021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05af5-4a26-463a-aa60-9113625f5405 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:15.467175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:15.488410 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:15.489231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:15.489522 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:15.489833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:15.497425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:15.498974 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:15.513784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:15.514764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:15.515707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 436/871] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:15.522593 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:15.615236 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:15.632348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba30b-2610-41aa-aa0b-c55861a1e881 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:15.669432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e227a-8914-4fae-843d-4c1caed39377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:15.670571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e227a-8914-4fae-843d-4c1caed39377 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:15.671063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e227a-8914-4fae-843d-4c1caed39377 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:15.671553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e227a-8914-4fae-843d-4c1caed39377 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:15.672550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e227a-8914-4fae-843d-4c1caed39377 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:15.673085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e227a-8914-4fae-843d-4c1caed39377 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:15.674790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e227a-8914-4fae-843d-4c1caed39377 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:15.693649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 436/872] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:15.696779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:15.806593 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cece126-a1bf-4ae4-9c20-d93f2547fa65 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:15.843594 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c034d-10b0-446d-a93b-fcdcf1af801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:15.844264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c034d-10b0-446d-a93b-fcdcf1af801d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:15.844552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c034d-10b0-446d-a93b-fcdcf1af801d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:15.844832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c034d-10b0-446d-a93b-fcdcf1af801d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:15.845665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c034d-10b0-446d-a93b-fcdcf1af801d None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=cd2f4a2f2f06432b9c9352ac707a6527) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:15.846006 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c034d-10b0-446d-a93b-fcdcf1af801d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:15.847460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c034d-10b0-446d-a93b-fcdcf1af801d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:15.854206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 437/873] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:15 2022] GET /identity/v3/role_assignments?user.id=cd2f4a2f2f06432b9c9352ac707a6527&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:15.878577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc9f8-c54b-4509-8c3f-7fe0dfb6359b None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:15.878848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc9f8-c54b-4509-8c3f-7fe0dfb6359b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:15.879073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc9f8-c54b-4509-8c3f-7fe0dfb6359b None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:15.880810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 437/874] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:15.887292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0f013-3a4c-415c-b96e-cb4a1180b608 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:15.887610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0f013-3a4c-415c-b96e-cb4a1180b608 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:15.887874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0f013-3a4c-415c-b96e-cb4a1180b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:15.906644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-cfa0f013-3a4c-415c-b96e-cb4a1180b608 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:15.907894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-cfa0f013-3a4c-415c-b96e-cb4a1180b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:15.964172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:16.000393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 438/875] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:16.023384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cc9f8-c54b-4509-8c3f-7fe0dfb6359b None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:16.120138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5efb5-7d1f-45a5-a86f-768760098247 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:16.120470 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5efb5-7d1f-45a5-a86f-768760098247 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:16.120706 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5efb5-7d1f-45a5-a86f-768760098247 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:16.122980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 439/876] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:16.132391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09635d-ea2f-410d-8360-35750646b9eb None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:16.132680 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09635d-ea2f-410d-8360-35750646b9eb None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:16.132894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09635d-ea2f-410d-8360-35750646b9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:16.143578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cc9f8-c54b-4509-8c3f-7fe0dfb6359b None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:16.155723 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-ec09635d-ea2f-410d-8360-35750646b9eb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:16.156924 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ec09635d-ea2f-410d-8360-35750646b9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:16.184463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:16.185267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:16.185558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:16.187164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:16.187164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:16.187992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:16.202391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:16.203454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:16.204588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 438/877] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:16.216223 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:16.230661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:16.243334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 440/878] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:16.268647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09635d-ea2f-410d-8360-35750646b9eb None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:16.344079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933ca1-cdfd-4d53-9cda-9adb73e531ea None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:16.380220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:16.380902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:16.381196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:16.381452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:16.384118 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:16.384922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:16.386347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:16.395991 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 439/879] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:16.396146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09635d-ea2f-410d-8360-35750646b9eb None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:16.396968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:16.397299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:16.437855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fa1c2-9a85-4e32-8222-80e0c6acae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:16.438544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa1c2-9a85-4e32-8222-80e0c6acae94 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:16.438833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa1c2-9a85-4e32-8222-80e0c6acae94 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:16.439116 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa1c2-9a85-4e32-8222-80e0c6acae94 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:16.440026 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fa1c2-9a85-4e32-8222-80e0c6acae94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:16.441580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fa1c2-9a85-4e32-8222-80e0c6acae94 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:16.463331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 441/880] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:37:16 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:37:16.491390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:16.521375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36387a76-d2dd-48e9-a100-7f3743a3011b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:16.569312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186753a-2f68-451d-9097-33909a148814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:16.570387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186753a-2f68-451d-9097-33909a148814 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:16.570827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186753a-2f68-451d-9097-33909a148814 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:16.571333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186753a-2f68-451d-9097-33909a148814 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:16.572258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186753a-2f68-451d-9097-33909a148814 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:16.572772 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186753a-2f68-451d-9097-33909a148814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:16.574389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186753a-2f68-451d-9097-33909a148814 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:16.580431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 440/881] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:17.571027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f71eae-28bb-4c12-a677-d50d42494923 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:17.571582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f71eae-28bb-4c12-a677-d50d42494923 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:17.571582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f71eae-28bb-4c12-a677-d50d42494923 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:17.573288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 442/882] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:17.578287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058881b-2056-4fce-8eff-f18dc9d22965 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:17.578690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058881b-2056-4fce-8eff-f18dc9d22965 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:17.578859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058881b-2056-4fce-8eff-f18dc9d22965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:17.600123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-7058881b-2056-4fce-8eff-f18dc9d22965 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:17.601336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-7058881b-2056-4fce-8eff-f18dc9d22965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:17.674799 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 441/883] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:17.696974 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f71eae-28bb-4c12-a677-d50d42494923 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:17.810778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f71eae-28bb-4c12-a677-d50d42494923 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:17.847068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:17.847885 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:17.848226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:17.848445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:17.849158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:17.850593 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:17.863691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:17.864714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:17.866148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 443/884] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:17.870886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058881b-2056-4fce-8eff-f18dc9d22965 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:17.938398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:17.982869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058881b-2056-4fce-8eff-f18dc9d22965 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:18.019249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:18.020283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.020774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.021255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.022202 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:18.022735 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:18.024309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:18.029972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 442/885] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:18.039199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:18.070133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:18.151407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9177f-8643-45a7-b3d4-9a3c1511296f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:18.190880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd626a4e-bc9f-4bf0-884e-10523450071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:18.191558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd626a4e-bc9f-4bf0-884e-10523450071f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.191851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd626a4e-bc9f-4bf0-884e-10523450071f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.192138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd626a4e-bc9f-4bf0-884e-10523450071f None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.192924 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd626a4e-bc9f-4bf0-884e-10523450071f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:18.193241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd626a4e-bc9f-4bf0-884e-10523450071f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:18.194718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd626a4e-bc9f-4bf0-884e-10523450071f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:18.200330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 444/886] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:18.206317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:18.314496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939caef-cc78-4293-bcb7-aba090033202 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:18.343116 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:18.359118 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:18.360134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.360619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.361114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.362212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] RBAC: Adding query filter params (interface=public, service_id=8fe69b38a40d46748637d3fe4d5b05e4, region_id=RegionOne) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:18.362748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:18.364426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:18.365320 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a4c7-f4a1-4cb0-92c1-bffabb2fe922 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.365620 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a4c7-f4a1-4cb0-92c1-bffabb2fe922 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.365945 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a4c7-f4a1-4cb0-92c1-bffabb2fe922 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.367582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 445/887] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:18.372578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 443/888] 10.222.0.13 () {56 vars in 1251 bytes} [Wed May 25 13:37:18 2022] GET /identity/v3/endpoints?service_id=8fe69b38a40d46748637d3fe4d5b05e4&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:18.373827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5a0f-47ed-4b17-b01c-e690c62cc786 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.373827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5a0f-47ed-4b17-b01c-e690c62cc786 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.373827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5a0f-47ed-4b17-b01c-e690c62cc786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.378495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:18.393703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-925e5a0f-47ed-4b17-b01c-e690c62cc786 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:18.395379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-925e5a0f-47ed-4b17-b01c-e690c62cc786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:18.489823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 446/889] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:18.504028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4c2e9-bdb1-4458-9c11-330094650a59 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:18.518281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e5a0f-47ed-4b17-b01c-e690c62cc786 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:18.546228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:18.558378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c2c7-1099-4529-b331-ce761c6f8bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:18.559841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c2c7-1099-4529-b331-ce761c6f8bcd None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.560620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c2c7-1099-4529-b331-ce761c6f8bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.561138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c2c7-1099-4529-b331-ce761c6f8bcd None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.562082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c2c7-1099-4529-b331-ce761c6f8bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:18.563889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c2c7-1099-4529-b331-ce761c6f8bcd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:18.572431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 444/890] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:37:18 2022] GET /identity/v3/services => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:37:18.642631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e5a0f-47ed-4b17-b01c-e690c62cc786 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:18.683589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600036d-2088-4398-be38-559f21616d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:18.684832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600036d-2088-4398-be38-559f21616d97 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.685339 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600036d-2088-4398-be38-559f21616d97 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.685855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600036d-2088-4398-be38-559f21616d97 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.698852 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600036d-2088-4398-be38-559f21616d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-d600036d-2088-4398-be38-559f21616d97 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:18.707389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:18.708672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:18.709836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 447/891] 10.222.0.13 () {56 vars in 1120 bytes} [Wed May 25 13:37:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:18.719771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c2c7-1099-4529-b331-ce761c6f8bcd None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:18.731669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411355b0-6735-4dbf-81f8-75002b799e07 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.732029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411355b0-6735-4dbf-81f8-75002b799e07 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.732245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411355b0-6735-4dbf-81f8-75002b799e07 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.734008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 448/892] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:18.740022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10fae-51cc-45aa-9e63-bc35cccf1b80 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.740539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10fae-51cc-45aa-9e63-bc35cccf1b80 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.740980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a10fae-51cc-45aa-9e63-bc35cccf1b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.759691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-60a10fae-51cc-45aa-9e63-bc35cccf1b80 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:18.761155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-60a10fae-51cc-45aa-9e63-bc35cccf1b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:18.797449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:18.849994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c2c7-1099-4529-b331-ce761c6f8bcd None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:18.854712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 449/893] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:18.877338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a10fae-51cc-45aa-9e63-bc35cccf1b80 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:18.890260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:18.894648 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff31857-4e72-4522-995a-b6e65a8a9377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:18.895338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31857-4e72-4522-995a-b6e65a8a9377 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.896557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31857-4e72-4522-995a-b6e65a8a9377 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.896557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31857-4e72-4522-995a-b6e65a8a9377 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.896939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff31857-4e72-4522-995a-b6e65a8a9377 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:18.897332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff31857-4e72-4522-995a-b6e65a8a9377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:18.898877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff31857-4e72-4522-995a-b6e65a8a9377 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:18.910300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 445/894] 10.222.0.13 () {56 vars in 1115 bytes} [Wed May 25 13:37:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:18.911971 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7013-c1ed-4554-814a-8e7f471b0cb3 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:18.912263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7013-c1ed-4554-814a-8e7f471b0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:18.912540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f7013-c1ed-4554-814a-8e7f471b0cb3 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:18.913936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 446/895] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:18.915907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f7013-c1ed-4554-814a-8e7f471b0cb3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:18.985798 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a10fae-51cc-45aa-9e63-bc35cccf1b80 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.020671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a852084-cd5c-426d-8401-edae668d817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.021408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a852084-cd5c-426d-8401-edae668d817b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.021692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a852084-cd5c-426d-8401-edae668d817b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.022021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a852084-cd5c-426d-8401-edae668d817b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.022660 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a852084-cd5c-426d-8401-edae668d817b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.024047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a852084-cd5c-426d-8401-edae668d817b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.029747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f7013-c1ed-4554-814a-8e7f471b0cb3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-2a852084-cd5c-426d-8401-edae668d817b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:19.036793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:19.037839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:19.038724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 450/896] 10.222.0.13 () {56 vars in 1132 bytes} [Wed May 25 13:37:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:19.039647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831e6ca-f209-4a02-bcb9-e2997c656cb5 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.039942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831e6ca-f209-4a02-bcb9-e2997c656cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.040218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831e6ca-f209-4a02-bcb9-e2997c656cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.054197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:19.057485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-7831e6ca-f209-4a02-bcb9-e2997c656cb5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:19.059130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-7831e6ca-f209-4a02-bcb9-e2997c656cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:19.076736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.077538 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.077858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.078142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.089837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.091315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:19.110095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:19.111103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:19.112031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:19.112031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:19.112031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:19.112031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:19.112031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 447/897] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:19.112698 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:19.137471 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 451/898] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:19.138732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831e6ca-f209-4a02-bcb9-e2997c656cb5 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:19.147147 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:19.244557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69cb9-1232-4547-8c98-e3c7a98cda61 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.256620 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831e6ca-f209-4a02-bcb9-e2997c656cb5 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.280987 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.281721 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.282037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.282343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.283136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:19.283562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.284927 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.294483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 448/899] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:19.294649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.294756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:19.294833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.294833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.294833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.294833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:19.294833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.294833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.315504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 452/900] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:19.315504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:19.337948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:19.386337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:19.407736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25831f-94d3-486f-b64f-24f854e291ad None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.426389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4bf35-44a8-4862-8b46-6cdfb952c5da None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.443976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d19f-8692-49d6-bf43-69d6f7823d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.444867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d19f-8692-49d6-bf43-69d6f7823d8c None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.445331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d19f-8692-49d6-bf43-69d6f7823d8c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.445790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d19f-8692-49d6-bf43-69d6f7823d8c None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.449471 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d19f-8692-49d6-bf43-69d6f7823d8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.451076 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d19f-8692-49d6-bf43-69d6f7823d8c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.464803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.465475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.465780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.466067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.466778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:19.467089 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.476397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.476624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 449/901] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:37:19 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:19.476624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d19f-8692-49d6-bf43-69d6f7823d8c None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:19.476812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 453/902] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:19.482431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:19.610208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de0c3-f0ab-41ce-97ac-8aaf6484360f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.616252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:19.635145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d19f-8692-49d6-bf43-69d6f7823d8c None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.650898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:19.659233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.660103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.660404 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.660746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.661820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] RBAC: Adding query filter params (interface=public, service_id=a3cd9b58e561473faf4c4fdda919e661, region_id=RegionOne) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:19.662140 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.663537 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.673770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 454/903] 10.222.0.13 () {56 vars in 1251 bytes} [Wed May 25 13:37:19 2022] GET /identity/v3/endpoints?service_id=a3cd9b58e561473faf4c4fdda919e661&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:19.676787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:19.680450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.681911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.682197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.682472 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.692014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.693460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:19.712510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:19.713613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:19.714745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 450/904] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:37:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:19.719572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:19.819077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68012eb6-3153-4f48-a8e2-336d3f7bae08 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.862305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0221-5c10-4df8-bc87-77cb5bd239b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.862903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0221-5c10-4df8-bc87-77cb5bd239b0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.863189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0221-5c10-4df8-bc87-77cb5bd239b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.863465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0221-5c10-4df8-bc87-77cb5bd239b0 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.864152 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a0221-5c10-4df8-bc87-77cb5bd239b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.865540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a0221-5c10-4df8-bc87-77cb5bd239b0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.872541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660017d-f80f-471f-b398-649e27252b87 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:19.880660 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 455/905] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:37:19 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:37:19.914524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:19.916231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:19.916729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:19.917204 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:19.918302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:19.918839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:19.920528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:19.946678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 451/906] 10.222.0.13 () {56 vars in 1149 bytes} [Wed May 25 13:37:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:19.952690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0221-5c10-4df8-bc87-77cb5bd239b0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:20.021742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:20.069571 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0221-5c10-4df8-bc87-77cb5bd239b0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:20.105382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd261dd-2024-4df4-b263-171ca5c199e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:20.106075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd261dd-2024-4df4-b263-171ca5c199e8 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:20.106362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd261dd-2024-4df4-b263-171ca5c199e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:20.106640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd261dd-2024-4df4-b263-171ca5c199e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:20.176216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd261dd-2024-4df4-b263-171ca5c199e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:20.177619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd261dd-2024-4df4-b263-171ca5c199e8 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:20.234428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:20.280519 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 456/907] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:37:20.286404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:20.298373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:20.403485 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655bbba-4dcf-4653-9fbc-eac8c594b415 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:20.437755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:20.438546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:20.438829 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:20.439102 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:20.449852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:20.451294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:20.469603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:20.470573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:20.471683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:20.471683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:20.471683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:20.471683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:20.471683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 452/908] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:20.477936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd261dd-2024-4df4-b263-171ca5c199e8 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:20.594567 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd261dd-2024-4df4-b263-171ca5c199e8 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:20.629000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:20.629718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:20.630033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:20.633752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:20.633752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:20.633752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:20.633752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:20.645330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 457/909] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:20.651518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:20.717265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:20.767278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea9c92-a45d-40f8-b4b4-d0361ab525b9 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:20.811289 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe270902-befb-4bdc-a11b-8978be22e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:20.812092 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270902-befb-4bdc-a11b-8978be22e21b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:20.812374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270902-befb-4bdc-a11b-8978be22e21b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:20.812649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270902-befb-4bdc-a11b-8978be22e21b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:20.819882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe270902-befb-4bdc-a11b-8978be22e21b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:20.821318 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe270902-befb-4bdc-a11b-8978be22e21b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-fe270902-befb-4bdc-a11b-8978be22e21b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:20.836386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:20.837350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:20.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:20.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:20.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:20.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:20.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:20.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:20.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:20.838307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:20.841850 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 453/910] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:20.846808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:20.866704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:20.954879 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829941c2-85d4-468b-b830-29f53ae41bd8 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:20.967862 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa65d5b-2e9d-47dc-aac2-234595295043 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:20.968344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa65d5b-2e9d-47dc-aac2-234595295043 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:20.968344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa65d5b-2e9d-47dc-aac2-234595295043 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:20.969951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 454/911] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:20.975068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190f48-b7e4-4b11-8316-5d4078fea25a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:20.975355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190f48-b7e4-4b11-8316-5d4078fea25a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:20.975632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190f48-b7e4-4b11-8316-5d4078fea25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:20.991934 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:20.992602 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:20.992892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:20.993172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:20.993363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b4190f48-b7e4-4b11-8316-5d4078fea25a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:20.994512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:20.994829 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:20.995245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b4190f48-b7e4-4b11-8316-5d4078fea25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:20.996292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:21.009027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 458/912] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:21.016754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:21.081755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 455/913] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:21.099653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4190f48-b7e4-4b11-8316-5d4078fea25a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:21.108487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:21.134196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9640f76-d488-471d-b0af-19bb14874fca None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:21.183862 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:21.184563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:21.184853 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:21.185134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:21.186134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] RBAC: Adding query filter params (role.id=567960a6d9004ce3a62daa2a63414d13, scope.project.id=c0b98559906540c082df06432223b497, user.id=cd2f4a2f2f06432b9c9352ac707a6527) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:21.186454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:21.187930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:21.193659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:21.202084 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 459/914] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:21 2022] GET /identity/v3/role_assignments?user.id=cd2f4a2f2f06432b9c9352ac707a6527&scope.project.id=c0b98559906540c082df06432223b497&role.id=567960a6d9004ce3a62daa2a63414d13 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:21.283283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4190f48-b7e4-4b11-8316-5d4078fea25a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:21.342209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:21.343433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:21.343856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:21.344282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:21.345344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:21.347579 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:21.368582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:21.369650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 13:37:21.370549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:21.371302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 456/915] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:21.376804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:21.496511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eaafb-1bb3-42f9-9b5f-bd8670e1514d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:21.533627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:21.534275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:21.534563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:21.534848 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:21.535572 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:21.535886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:21.537295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:21.543129 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 460/916] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:21.548873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:21.695746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2958fb-365d-4872-a2cf-2e488a014fa3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:21.718000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:21.747040 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283256b-ac6b-4d12-8efc-80bd558383ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:21.747820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283256b-ac6b-4d12-8efc-80bd558383ed None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:21.748117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283256b-ac6b-4d12-8efc-80bd558383ed None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:21.748398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283256b-ac6b-4d12-8efc-80bd558383ed None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:21.749123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283256b-ac6b-4d12-8efc-80bd558383ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:21.749436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283256b-ac6b-4d12-8efc-80bd558383ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:21.750875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283256b-ac6b-4d12-8efc-80bd558383ed None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:21.756685 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 457/917] 10.222.0.13 () {56 vars in 1114 bytes} [Wed May 25 13:37:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:21.762978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:21.767009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:21.825671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593516-3a47-4b6e-a07f-677f1170b8bf None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:21.826107 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593516-3a47-4b6e-a07f-677f1170b8bf None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:21.826321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593516-3a47-4b6e-a07f-677f1170b8bf None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:21.828263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 458/918] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:21.839407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbee209-b82b-4d89-bfac-0a1aab89cc0b None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:21.839841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbee209-b82b-4d89-bfac-0a1aab89cc0b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:21.840322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbee209-b82b-4d89-bfac-0a1aab89cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:21.858940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9fbee209-b82b-4d89-bfac-0a1aab89cc0b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:21.860300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9fbee209-b82b-4d89-bfac-0a1aab89cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:21.901027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d68ef2-80b4-4bed-843d-1c03ced58cbf None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:21.942216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 459/919] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:21.954167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b065-dd05-49fc-8e61-f70a6dd63d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:21.955373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b065-dd05-49fc-8e61-f70a6dd63d66 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:21.956007 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b065-dd05-49fc-8e61-f70a6dd63d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:21.956584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b065-dd05-49fc-8e61-f70a6dd63d66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:21.957947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935b065-dd05-49fc-8e61-f70a6dd63d66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:21.960393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935b065-dd05-49fc-8e61-f70a6dd63d66 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:21.961624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbee209-b82b-4d89-bfac-0a1aab89cc0b None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:21.990815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 461/920] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:37:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:22.088697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbee209-b82b-4d89-bfac-0a1aab89cc0b None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:22.100506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:22.136976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708e6e9-a6db-4a3c-bcbe-af4126e03c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:22.138262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e6e9-a6db-4a3c-bcbe-af4126e03c7e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.138775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e6e9-a6db-4a3c-bcbe-af4126e03c7e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.139251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e6e9-a6db-4a3c-bcbe-af4126e03c7e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.140128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708e6e9-a6db-4a3c-bcbe-af4126e03c7e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:22.141766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708e6e9-a6db-4a3c-bcbe-af4126e03c7e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-5708e6e9-a6db-4a3c-bcbe-af4126e03c7e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:22.155858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:22.156955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:22.157867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:22.160965 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 460/921] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:22.167454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b065-dd05-49fc-8e61-f70a6dd63d66 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:22.237190 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1afb56-b608-49dd-9fb5-998bb4bd4722 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.237539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1afb56-b608-49dd-9fb5-998bb4bd4722 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.237768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1afb56-b608-49dd-9fb5-998bb4bd4722 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.239302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 461/922] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:22.244361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b360d7-fe3d-43d2-aa82-d18e193c375d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.244718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b360d7-fe3d-43d2-aa82-d18e193c375d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.244913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b360d7-fe3d-43d2-aa82-d18e193c375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.245946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:22.266856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-25b360d7-fe3d-43d2-aa82-d18e193c375d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:22.268106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-25b360d7-fe3d-43d2-aa82-d18e193c375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:22.297541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b065-dd05-49fc-8e61-f70a6dd63d66 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:22.342790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:22.344451 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.345230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.345743 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.347342 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:22.348170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:22.350047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:22.352045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 462/923] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:22.360151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 462/924] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:22.366093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b360d7-fe3d-43d2-aa82-d18e193c375d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:22.375089 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:22.490874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733df9a-e7cc-4e71-a3bc-d0a8a788d32a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:22.511186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:22.516352 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b360d7-fe3d-43d2-aa82-d18e193c375d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:22.519866 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:22.534983 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:22.535838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.536233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.536524 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.537179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:22.538610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:22.552407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:22.553483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 13:37:22.554408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:22.559291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 463/925] 10.222.0.13 () {56 vars in 1132 bytes} [Wed May 25 13:37:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:22.560301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:22.565596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:22.566874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.567385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.567903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.568823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:22.569333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:22.571570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:22.580596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 463/926] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:22.587818 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:22.684851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f3fa-7fdc-4f7d-bb49-6680c426d01b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:22.722929 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:22.723640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.723930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.724213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.724856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4e4e-e55e-49f7-99d5-dae3a6cf1037 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:22.724966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:22.725228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:22.726832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:22.732753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 464/927] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:22.740214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:22.767251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:22.768073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.768670 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.768962 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.770079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] RBAC: Adding query filter params (interface=public, service_id=e2f70767736040d8a0ca362420eca7d9, region_id=RegionOne) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:22.770395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:22.772515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:22.782494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 464/928] 10.222.0.13 () {56 vars in 1251 bytes} [Wed May 25 13:37:22 2022] GET /identity/v3/endpoints?service_id=e2f70767736040d8a0ca362420eca7d9&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:22.786668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:22.808645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:22.821671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:22.865884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6e887-a570-44d7-ba29-d3023ba318c5 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:22.907730 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:22.908704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.909000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.909284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.910311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:22.910633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:22.912747 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:22.914267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8ff42-ed68-4ce0-8a6f-f68a276df289 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:22.925959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 465/929] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:22.926970 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:22.966716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58cfb-286f-45e0-80f9-4fc85f326e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:22.967759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58cfb-286f-45e0-80f9-4fc85f326e3f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:22.968052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58cfb-286f-45e0-80f9-4fc85f326e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:22.968604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58cfb-286f-45e0-80f9-4fc85f326e3f None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:22.969313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d58cfb-286f-45e0-80f9-4fc85f326e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:22.971797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d58cfb-286f-45e0-80f9-4fc85f326e3f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:22.986036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 465/930] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:37:22 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:37:23.052459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e366d4-fd85-4538-91aa-dfd072477f07 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:23.071442 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:23.100470 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3af5-0efe-4b6b-844a-04ea85bfed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:23.101171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3af5-0efe-4b6b-844a-04ea85bfed18 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:23.101464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3af5-0efe-4b6b-844a-04ea85bfed18 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:23.101769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3af5-0efe-4b6b-844a-04ea85bfed18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:23.102568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d3af5-0efe-4b6b-844a-04ea85bfed18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:23.104716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d3af5-0efe-4b6b-844a-04ea85bfed18 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:23.127860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 466/931] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:37:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:23.630697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b257a-a881-4e44-ac25-59929cc74c62 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:23.631304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b257a-a881-4e44-ac25-59929cc74c62 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:23.631304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b257a-a881-4e44-ac25-59929cc74c62 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:23.632848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 466/932] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:23.638907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bdea0-91e8-4ae8-acf5-f6a7e0f61a92 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:23.639202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bdea0-91e8-4ae8-acf5-f6a7e0f61a92 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:23.639487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bdea0-91e8-4ae8-acf5-f6a7e0f61a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:23.657462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-4c9bdea0-91e8-4ae8-acf5-f6a7e0f61a92 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:23.658688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-4c9bdea0-91e8-4ae8-acf5-f6a7e0f61a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:23.740198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 467/933] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:23.763300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b257a-a881-4e44-ac25-59929cc74c62 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:23.874565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:23.886284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b257a-a881-4e44-ac25-59929cc74c62 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:23.921224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff0da2-5f62-41c5-8669-f8406163b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:23.922068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff0da2-5f62-41c5-8669-f8406163b34b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:23.922352 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff0da2-5f62-41c5-8669-f8406163b34b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:23.922632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff0da2-5f62-41c5-8669-f8406163b34b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:23.933915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff0da2-5f62-41c5-8669-f8406163b34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-caff0da2-5f62-41c5-8669-f8406163b34b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:23.942115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:23.943069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:23.943932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 467/934] 10.222.0.13 () {56 vars in 1120 bytes} [Wed May 25 13:37:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:23.949878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bdea0-91e8-4ae8-acf5-f6a7e0f61a92 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:24.049164 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:24.054279 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bdea0-91e8-4ae8-acf5-f6a7e0f61a92 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:24.090895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:24.091571 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:24.091854 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:24.092132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:24.092879 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:24.093186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:24.094598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:24.103709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 468/935] 10.222.0.13 () {56 vars in 1115 bytes} [Wed May 25 13:37:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:24.110805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff0da2-5f62-41c5-8669-f8406163b34b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:24.220293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff0da2-5f62-41c5-8669-f8406163b34b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:24.258892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72c29-e103-4d14-9ee0-030442d56d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:24.259773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72c29-e103-4d14-9ee0-030442d56d6e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:24.260059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72c29-e103-4d14-9ee0-030442d56d6e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:24.260339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72c29-e103-4d14-9ee0-030442d56d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:24.273773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72c29-e103-4d14-9ee0-030442d56d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:24.275384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72c29-e103-4d14-9ee0-030442d56d6e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-84b72c29-e103-4d14-9ee0-030442d56d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:24.295216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:24.297405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:24.299539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:24.299539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:24.299539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:24.299539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:24.299539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 468/936] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:24.303155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:24.419777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710dc4-9497-4276-b6cc-cd555569c3c7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:24.459013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763bee3-3d3f-473a-aa4a-b003ebd90487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:24.459685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bee3-3d3f-473a-aa4a-b003ebd90487 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:24.459970 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bee3-3d3f-473a-aa4a-b003ebd90487 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:24.460251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bee3-3d3f-473a-aa4a-b003ebd90487 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:24.461234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763bee3-3d3f-473a-aa4a-b003ebd90487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:24.461543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763bee3-3d3f-473a-aa4a-b003ebd90487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:24.463485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763bee3-3d3f-473a-aa4a-b003ebd90487 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:24.476285 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 469/937] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:24.478493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7955e-6564-4a0c-ae78-61d230e4bbe9 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:24.478972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7955e-6564-4a0c-ae78-61d230e4bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:24.479386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7955e-6564-4a0c-ae78-61d230e4bbe9 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:24.481095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 469/938] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:24.486966 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7955e-6564-4a0c-ae78-61d230e4bbe9 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:24.487433 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1cfdb-25ca-4405-ba92-f49faa63b648 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:24.487869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1cfdb-25ca-4405-ba92-f49faa63b648 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:24.488302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1cfdb-25ca-4405-ba92-f49faa63b648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:24.491533 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:24.509795 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-1ab1cfdb-25ca-4405-ba92-f49faa63b648 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:24.511360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1ab1cfdb-25ca-4405-ba92-f49faa63b648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:24.529030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:24.591914 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 470/939] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:24.616202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1cfdb-25ca-4405-ba92-f49faa63b648 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:24.652125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7955e-6564-4a0c-ae78-61d230e4bbe9 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:24.693978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:24.695599 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:24.695891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:24.696171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:24.705981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:24.707984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:24.727449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:24.729011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:24.730077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 470/940] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:37:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:24.736075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1cfdb-25ca-4405-ba92-f49faa63b648 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:24.736925 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:24.776561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:24.777832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:24.778373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:24.778851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:24.785444 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:24.787390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:24.789142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING keystone.server.flask.common [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 13:37:24.807537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:24.816157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.sql.core [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 13:37:24.816157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 13:37:24.816157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [parameters: {'id': '30477061cabd4cb09c2b31945ad125df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 13:37:24.816157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86847) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 30477061cabd4cb09c2b31945ad125df.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 30477061cabd4cb09c2b31945ad125df. May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application conn.query(q) May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:37:24.827563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application result.read() May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 13:37:24.828424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application next(self.gen) May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application yield resource May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application next(self.gen) May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.session.rollback() May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.force_reraise() May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise self.value May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application session.commit() May 25 13:37:24.829408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._prepare_impl() May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.session.flush() May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._flush(objects) May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application compat.raise_( May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application flush_context.execute() May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 13:37:24.830378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rec.execute(self) May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 13:37:24.831291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application conn.query(q) May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application result.read() May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:37:24.832112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [parameters: {'id': '30477061cabd4cb09c2b31945ad125df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:24.833005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:24.840765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 30477061cabd4cb09c2b31945ad125df. May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 471/941] 10.222.0.13 () {60 vars in 1140 bytes} [Wed May 25 13:37:24 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:24.843095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:24.857208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:24.867310 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22428b2-5c45-49f1-b3b2-491953cc6977 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:24.907409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:24.908240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:24.908812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:24.909309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:24.910507 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:24.911121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:24.912904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:24.934355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 471/942] 10.222.0.13 () {56 vars in 1149 bytes} [Wed May 25 13:37:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:24.940068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:24.977223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b826ea6-15ec-46a8-b595-95bf11c2662b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.017150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.018387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.019021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.019595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.028728 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.030760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:25.046675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:25.047622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:25.048546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:25.048546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:25.048546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:25.048546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:25.048546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:25.048546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:25.048546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:25.048546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:25.051216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 472/943] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:25.056923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.070649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b7258-e8fe-48dc-bfa9-1d9ced7a190d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.097517 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:25.114529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.115361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.115650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.115922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.128494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.130103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:25.150858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:25.151869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:25.152782 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:25.152782 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:25.152782 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:25.152782 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:25.157044 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 472/944] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:25.158082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.159549 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:25.209351 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec6bb-d14d-4782-af15-4f040658d41f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.260973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ee2f2-c522-4c74-9f0f-2db3f7b947f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.262855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee2f2-c522-4c74-9f0f-2db3f7b947f2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.263419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee2f2-c522-4c74-9f0f-2db3f7b947f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.264227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee2f2-c522-4c74-9f0f-2db3f7b947f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.265561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ee2f2-c522-4c74-9f0f-2db3f7b947f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:25.266146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ee2f2-c522-4c74-9f0f-2db3f7b947f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.268753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ee2f2-c522-4c74-9f0f-2db3f7b947f2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.276649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10689-dc7e-4519-aec9-0e4ca92a5357 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.307194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 473/945] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:25.312255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8be70-3c83-49a3-b889-b9039cd645e9 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.312535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8be70-3c83-49a3-b889-b9039cd645e9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.312820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8be70-3c83-49a3-b889-b9039cd645e9 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.318394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 474/946] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:25.320640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c6439-250a-4bfd-937f-ffe9b8f69509 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.320931 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c6439-250a-4bfd-937f-ffe9b8f69509 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.321212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c6439-250a-4bfd-937f-ffe9b8f69509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.331638 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.332645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.333155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.333674 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.334790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:25.335304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.337222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.341531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-4e1c6439-250a-4bfd-937f-ffe9b8f69509 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:25.343271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-4e1c6439-250a-4bfd-937f-ffe9b8f69509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:25.358050 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 473/947] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:25.360945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.403059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:25.448537 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 475/948] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:25.450111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7a7d1-d763-4f8f-b808-e26cf01870c4 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.450409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7a7d1-d763-4f8f-b808-e26cf01870c4 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.450689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7a7d1-d763-4f8f-b808-e26cf01870c4 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.452211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 476/949] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:25.458185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a1fdb-99e7-49a8-af1a-e30c2f0e71c9 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.458520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a1fdb-99e7-49a8-af1a-e30c2f0e71c9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.458760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a1fdb-99e7-49a8-af1a-e30c2f0e71c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.479041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-5a1a1fdb-99e7-49a8-af1a-e30c2f0e71c9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:25.480265 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-5a1a1fdb-99e7-49a8-af1a-e30c2f0e71c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:25.501298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4b1b-f455-462e-8e0b-c96bbae9aeaf None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.545527 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.546358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.546705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.546990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.549233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:25.554737 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.556759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.569305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 477/950] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:25.571875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:25.572816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:25.573717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 474/951] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:25.574275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a1fdb-99e7-49a8-af1a-e30c2f0e71c9 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.580248 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.683493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a1fdb-99e7-49a8-af1a-e30c2f0e71c9 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.683834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:25.694026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c16c4-dc02-4ed4-ab92-6637fa149558 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.720582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.721398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.721687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.722001 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.722654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.724043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.730780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.731441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.731725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.731999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.732787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:25.733097 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.734544 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:25.736922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:25.738177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:25.739104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 478/952] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:25.739973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.758087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 475/953] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:25.758087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.801992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:25.857052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c9ead-82e8-4d5e-a409-977e2e656d98 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.868012 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bc6f6-ba2e-4b7d-85e8-6f2a66cd77c4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:25.896219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.897287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.897787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.898072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.898725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.900637 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.906588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:25.907264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:25.907548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:25.907822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:25.908532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:25.908840 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:25.910241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:25.912809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:25.913875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:25.914751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 479/954] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:25.916138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.926756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 476/955] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:25.926756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:25.944894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:26.024257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85741e-2a5e-4ff5-8af5-7e7be5b1f2dc None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:26.035228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd1ad9-e9b5-4b51-8a3d-f8e0a373019e None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:26.040081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:26.063543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ac523-1eb0-4077-81bd-4cb1945500a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:26.064490 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ac523-1eb0-4077-81bd-4cb1945500a2 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:26.064777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ac523-1eb0-4077-81bd-4cb1945500a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:26.065176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ac523-1eb0-4077-81bd-4cb1945500a2 None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/cd2f4a2f2f06432b9c9352ac707a6527/roles/567960a6d9004ce3a62daa2a63414d13` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:26.067541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ac523-1eb0-4077-81bd-4cb1945500a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=cd2f4a2f2f06432b9c9352ac707a6527, role_id=567960a6d9004ce3a62daa2a63414d13)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:26.069196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ac523-1eb0-4077-81bd-4cb1945500a2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:26.070229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:26.070926 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:26.071215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:26.071535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:26.072255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:26.072563 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:26.073943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:26.079015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 477/956] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:26.079801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:26.091003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 480/957] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:37:25 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/cd2f4a2f2f06432b9c9352ac707a6527/roles/567960a6d9004ce3a62daa2a63414d13 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:37:26.092137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ac523-1eb0-4077-81bd-4cb1945500a2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:26.212855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:26.231264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ac523-1eb0-4077-81bd-4cb1945500a2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:26.236953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d4498-0202-4bdd-8266-4fde0ee36732 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:26.271581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:26.272395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:26.272687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:26.272966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:26.273686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:26.274034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:26.276115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:26.278999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687fc7f-c2c6-49af-afd1-26fcd04f5e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:26.279946 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fc7f-c2c6-49af-afd1-26fcd04f5e2e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:26.280428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fc7f-c2c6-49af-afd1-26fcd04f5e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:26.280885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fc7f-c2c6-49af-afd1-26fcd04f5e2e None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:26.281832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fc7f-c2c6-49af-afd1-26fcd04f5e2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:26.281955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 481/958] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:26.282416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fc7f-c2c6-49af-afd1-26fcd04f5e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:26.283954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fc7f-c2c6-49af-afd1-26fcd04f5e2e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:26.293769 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 478/959] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:26.296012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:26.353278 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:26.429710 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478def01-e9af-4528-ae6d-cfa27f5c33e2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:26.469124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c31d20-8b7c-4c71-bf19-7bd05bf8a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:26.470017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31d20-8b7c-4c71-bf19-7bd05bf8a4d6 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:26.470410 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31d20-8b7c-4c71-bf19-7bd05bf8a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:26.470790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c31d20-8b7c-4c71-bf19-7bd05bf8a4d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:26.471781 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c31d20-8b7c-4c71-bf19-7bd05bf8a4d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:26.473315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c31d20-8b7c-4c71-bf19-7bd05bf8a4d6 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:26.495717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 482/960] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:37:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:37:27.703957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cd6f-893a-4e19-ba28-97c147e62da6 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:27.704486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cd6f-893a-4e19-ba28-97c147e62da6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:27.704486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cd6f-893a-4e19-ba28-97c147e62da6 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:27.706231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 479/961] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:27.712539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61785-8d58-45d2-af6c-acc1eb9d50fa None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:27.712979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61785-8d58-45d2-af6c-acc1eb9d50fa None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:27.713160 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61785-8d58-45d2-af6c-acc1eb9d50fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:27.730582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-fbf61785-8d58-45d2-af6c-acc1eb9d50fa None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:27.731765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-fbf61785-8d58-45d2-af6c-acc1eb9d50fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:27.821994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 483/962] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:27.842417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664cd6f-893a-4e19-ba28-97c147e62da6 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:27.944402 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664cd6f-893a-4e19-ba28-97c147e62da6 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:27.981265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:27.981897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:27.982191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:27.982473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:27.983196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:27.984643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:27.985999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING keystone.server.flask.common [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 13:37:27.999227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.sql.core [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 13:37:27.999227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 13:37:27.999227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [parameters: {'user_id': '4ada77e224814580bdad8cd4b5f1e11b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 13:37:27.999227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86846) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application conn.query(q) May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application result.read() May 25 13:37:28.016601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:37:28.017555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application next(self.gen) May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application yield resource May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application next(self.gen) May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self.session.rollback() May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self.force_reraise() May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise self.value May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application session.commit() May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 13:37:28.018614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._prepare_impl() May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self.session.flush() May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._flush(objects) May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application compat.raise_( May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application flush_context.execute() May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rec.execute(self) May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 13:37:28.019549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 13:37:28.020479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application result = self._query(query) May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application conn.query(q) May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application result.read() May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 13:37:28.021364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [parameters: {'user_id': '4ada77e224814580bdad8cd4b5f1e11b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:28.023888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 13:37:28.026393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 13:37:28.028313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 13:37:28.028313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 13:37:28.028313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 13:37:28.028313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 13:37:28.028313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 13:37:28.028313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:28.028313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 480/963] 10.222.0.13 () {60 vars in 1131 bytes} [Wed May 25 13:37:27 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:28.028818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61785-8d58-45d2-af6c-acc1eb9d50fa None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:28.047346 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:28.133064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61785-8d58-45d2-af6c-acc1eb9d50fa None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:28.168549 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc373d0-487c-48a6-bc6f-98a46f4ceeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:28.169355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc373d0-487c-48a6-bc6f-98a46f4ceeb3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.169639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc373d0-487c-48a6-bc6f-98a46f4ceeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.169945 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc373d0-487c-48a6-bc6f-98a46f4ceeb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.177573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc373d0-487c-48a6-bc6f-98a46f4ceeb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:28.179060 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc373d0-487c-48a6-bc6f-98a46f4ceeb3 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-0fc373d0-487c-48a6-bc6f-98a46f4ceeb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:28.194441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:28.197220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 13:37:28.199573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:28.201781 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 484/964] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:37:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:28.207083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:28.218238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:28.319375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ccb3-fbfb-4bda-89ac-8c5da1d01364 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:28.355755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd64dec-0c2d-4964-b976-de38282bc062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:28.356441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64dec-0c2d-4964-b976-de38282bc062 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.356734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64dec-0c2d-4964-b976-de38282bc062 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.357017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64dec-0c2d-4964-b976-de38282bc062 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.357864 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd64dec-0c2d-4964-b976-de38282bc062 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:28.358179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd64dec-0c2d-4964-b976-de38282bc062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:28.359851 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd64dec-0c2d-4964-b976-de38282bc062 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:28.400138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 481/965] 10.222.0.13 () {56 vars in 1101 bytes} [Wed May 25 13:37:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:28.480954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073739-f674-4edb-9b74-ae898fa44b7e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.481285 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073739-f674-4edb-9b74-ae898fa44b7e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.481528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c073739-f674-4edb-9b74-ae898fa44b7e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.483246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 485/966] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:28.489672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0befb-21fd-4b4d-b465-3d853c32301b None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.490355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0befb-21fd-4b4d-b465-3d853c32301b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.490927 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0befb-21fd-4b4d-b465-3d853c32301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.513347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-06f0befb-21fd-4b4d-b465-3d853c32301b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:28.515371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-06f0befb-21fd-4b4d-b465-3d853c32301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:28.583809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:28.594317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 482/967] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:28.619160 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c073739-f674-4edb-9b74-ae898fa44b7e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:28.642640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7443-8724-4910-af2b-94a8d2fcda1e None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.642966 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7443-8724-4910-af2b-94a8d2fcda1e None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.643220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7443-8724-4910-af2b-94a8d2fcda1e None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.644910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 483/968] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:28.650681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ab30-b6d4-4c4a-adc3-c8d033140c5d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.650992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ab30-b6d4-4c4a-adc3-c8d033140c5d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.652045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ab30-b6d4-4c4a-adc3-c8d033140c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.669241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-0073ab30-b6d4-4c4a-adc3-c8d033140c5d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:28.670789 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-0073ab30-b6d4-4c4a-adc3-c8d033140c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:28.733758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:28.756111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c073739-f674-4edb-9b74-ae898fa44b7e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:28.759190 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 484/969] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:28.784798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ab30-b6d4-4c4a-adc3-c8d033140c5d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:28.797632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3eb47f-5882-4578-b105-930b20e966f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:28.798516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3eb47f-5882-4578-b105-930b20e966f7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.798806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3eb47f-5882-4578-b105-930b20e966f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.799124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3eb47f-5882-4578-b105-930b20e966f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.811610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3eb47f-5882-4578-b105-930b20e966f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-cd3eb47f-5882-4578-b105-930b20e966f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:28.819894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:28.821083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:28.822186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 486/970] 10.222.0.13 () {56 vars in 1120 bytes} [Wed May 25 13:37:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:28.828022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3eb47f-5882-4578-b105-930b20e966f7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:28.897326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ab30-b6d4-4c4a-adc3-c8d033140c5d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:28.921403 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:28.932653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c69b10-466b-4234-a218-143d33f348a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:28.933307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69b10-466b-4234-a218-143d33f348a3 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.933591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69b10-466b-4234-a218-143d33f348a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.933688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3eb47f-5882-4578-b105-930b20e966f7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:28.933900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c69b10-466b-4234-a218-143d33f348a3 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.934620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c69b10-466b-4234-a218-143d33f348a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:28.935990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c69b10-466b-4234-a218-143d33f348a3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:28.948678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 485/971] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:37:28 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:28.950020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5970d7-9052-4697-8625-ab9988b52241 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.950311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5970d7-9052-4697-8625-ab9988b52241 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.950586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5970d7-9052-4697-8625-ab9988b52241 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.954524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 486/972] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:28.958642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215aa54-0c08-4983-bbc9-994deb3483d3 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.959098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215aa54-0c08-4983-bbc9-994deb3483d3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.959508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215aa54-0c08-4983-bbc9-994deb3483d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.979462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:28.980120 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-c215aa54-0c08-4983-bbc9-994deb3483d3 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:28.980247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:28.980429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:28.980697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:28.981347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-c215aa54-0c08-4983-bbc9-994deb3483d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:28.981527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:28.981858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:28.983290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:28.987036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:29.000197 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 487/973] 10.222.0.13 () {56 vars in 1115 bytes} [Wed May 25 13:37:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:29.001331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.066187 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 487/974] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:29.090241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215aa54-0c08-4983-bbc9-994deb3483d3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.114402 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc44b2-4d5c-485d-8749-96f1169340b0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.156601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.157329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.157613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.157917 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.171963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.173425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:29.193643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:29.194652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:29.195570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:29.195570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:29.195570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:29.195570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:29.195570 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 488/975] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:29.200517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.205600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215aa54-0c08-4983-bbc9-994deb3483d3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.221375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:29.246816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.247630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.248022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.248205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.248872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.250296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.253173 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:29.263210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:29.264490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:29.265358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 488/976] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:29.270304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.312271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b5f9-3b5b-4318-ab6c-5c62d3d3dfbd None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.351133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.351820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.352428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.352812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.353718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:29.354060 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.355458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.371312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 489/977] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:29.372713 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.382267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330deca-289b-4cd1-8c4a-0d3f803498a7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.419637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.420218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.420500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.420777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.421475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:29.421979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.423352 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.428759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 489/978] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:29.434881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.478459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7194da-ac25-4476-a41e-33bb1885aeaf None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.483387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:29.491043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:29.521396 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.522403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.522692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.522973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.531588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.533120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:29.548211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:29.549204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:29.550309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 490/979] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:29.552872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ce32-95dc-4601-b960-a24608681cba None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.554963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.590475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.591151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.591442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.591720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.592436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:29.592751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.594175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.599375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 490/980] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:29.605726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.669088 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93086-47da-49a8-8ec6-5955d2d4609a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.705749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.706438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.706737 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.707016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.707864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:29.708211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.709681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.720516 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca846e-0991-4c57-b40c-f91ac970ecde None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.728184 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 491/981] 10.222.0.13 () {56 vars in 1149 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:29.728696 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:29.733496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.760735 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.761404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.761691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.762013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.762815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] RBAC: Adding query filter params (interface=admin, service_id=e2f70767736040d8a0ca362420eca7d9, region_id=RegionOne) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:29.763136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.764508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.767208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:29.769990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 491/982] 10.222.0.13 () {56 vars in 1249 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/endpoints?service_id=e2f70767736040d8a0ca362420eca7d9&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:29.775322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:29.852463 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665be093-b08b-4b16-adf2-4e96c349e971 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.888291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4e56f-c1b9-443c-b203-65bfb113fb60 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:29.890782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc97c-b7b9-4219-85d5-72a3cf861ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.891443 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc97c-b7b9-4219-85d5-72a3cf861ea7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.891734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc97c-b7b9-4219-85d5-72a3cf861ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.892019 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc97c-b7b9-4219-85d5-72a3cf861ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.931577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a964d0-bbf5-47d2-bed7-39edf48bfd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:29.932250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a964d0-bbf5-47d2-bed7-39edf48bfd86 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:29.932537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a964d0-bbf5-47d2-bed7-39edf48bfd86 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:29.932819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a964d0-bbf5-47d2-bed7-39edf48bfd86 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:29.933517 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a964d0-bbf5-47d2-bed7-39edf48bfd86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.934941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a964d0-bbf5-47d2-bed7-39edf48bfd86 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:29.941587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 492/983] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:37:29.969780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc97c-b7b9-4219-85d5-72a3cf861ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:29.971221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc97c-b7b9-4219-85d5-72a3cf861ea7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:30.002462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:30.084254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 492/984] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:29 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:37:30.090384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a964d0-bbf5-47d2-bed7-39edf48bfd86 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:30.130196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:30.201764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a964d0-bbf5-47d2-bed7-39edf48bfd86 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:30.237541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:30.238297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:30.238587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:30.238874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:30.251271 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:30.252746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:30.270478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:30.271465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:30.272407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:30.272407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:30.272407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:30.272407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:30.272407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 493/985] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:30.278648 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc97c-b7b9-4219-85d5-72a3cf861ea7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:30.382045 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc97c-b7b9-4219-85d5-72a3cf861ea7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:30.409271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:30.418649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:30.419328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:30.419618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:30.419901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:30.420625 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:30.420938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:30.422480 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:30.438770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 493/986] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:30.440102 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:30.530088 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:30.546532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c81036-e7da-486c-8048-cb4433bc0092 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:30.585013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:30.586432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:30.586908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:30.587948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:30.595183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:30.596856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:30.612168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:30.613129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:30.614508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:30.614508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:30.614508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:30.614508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:30.614508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:30.614508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:30.614508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:30.614508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:30.615125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 494/987] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:30.620898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:30.723835 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10b0ed-e882-4e03-8e72-3d4c10ae7a97 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:30.759209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d80acb-01c2-40c8-b670-0c74db9e1d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:30.760239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80acb-01c2-40c8-b670-0c74db9e1d0b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:30.760760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80acb-01c2-40c8-b670-0c74db9e1d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:30.761249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d80acb-01c2-40c8-b670-0c74db9e1d0b None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:30.762319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d80acb-01c2-40c8-b670-0c74db9e1d0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:30.762869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d80acb-01c2-40c8-b670-0c74db9e1d0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:30.764535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d80acb-01c2-40c8-b670-0c74db9e1d0b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:30.778195 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 494/988] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:30.783848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:30.892350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5537-54bc-4ccf-981d-9a040d584490 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:30.926203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a18a3-53b8-4dc4-a55f-a876e93b841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:30.926853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a18a3-53b8-4dc4-a55f-a876e93b841b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:30.927141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a18a3-53b8-4dc4-a55f-a876e93b841b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:30.927423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a18a3-53b8-4dc4-a55f-a876e93b841b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:30.928255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a18a3-53b8-4dc4-a55f-a876e93b841b None admin] RBAC: Adding query filter params (role.id=567960a6d9004ce3a62daa2a63414d13, scope.project.id=c0b98559906540c082df06432223b497, user.id=cd2f4a2f2f06432b9c9352ac707a6527) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:30.928573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a18a3-53b8-4dc4-a55f-a876e93b841b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:30.930049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a18a3-53b8-4dc4-a55f-a876e93b841b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:30.941782 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 495/989] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:30 2022] GET /identity/v3/role_assignments?user.id=cd2f4a2f2f06432b9c9352ac707a6527&scope.project.id=c0b98559906540c082df06432223b497&role.id=567960a6d9004ce3a62daa2a63414d13 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:31.240989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cdd9a-6f88-4653-bfba-7720ced64eff None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:31.241283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cdd9a-6f88-4653-bfba-7720ced64eff None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:31.241567 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cdd9a-6f88-4653-bfba-7720ced64eff None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:31.242997 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 495/990] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:31.248977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa5ae-cc02-45a0-9d6a-673dc9557414 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:31.249277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa5ae-cc02-45a0-9d6a-673dc9557414 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:31.249568 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa5ae-cc02-45a0-9d6a-673dc9557414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:31.266898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-bccaa5ae-cc02-45a0-9d6a-673dc9557414 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:31.268103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-bccaa5ae-cc02-45a0-9d6a-673dc9557414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:31.271795 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:31.339396 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 496/991] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:31.361561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cdd9a-6f88-4653-bfba-7720ced64eff None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:31.413520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:31.467354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cdd9a-6f88-4653-bfba-7720ced64eff None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:31.503213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:31.503936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:31.504227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:31.504508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:31.505166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:31.506578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:31.518943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:31.520018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:31.520887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 496/992] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:31.526128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa5ae-cc02-45a0-9d6a-673dc9557414 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:31.628360 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa5ae-cc02-45a0-9d6a-673dc9557414 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:31.662294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:31.662967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:31.663253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:31.663530 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:31.664239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] RBAC: Adding query filter params (name=compute) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:31.664549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:31.666485 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:31.676242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 497/993] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:31.677282 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:31.787373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654221d-0f76-459e-8083-87c95599b022 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:31.805231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:31.828573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:31.829250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:31.829539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:31.829851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:31.830566 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:31.830879 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:31.832268 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:31.842354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 497/994] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:31.843372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:31.847314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:31.946815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86524ddb-1b5d-46a1-b1c0-7f0536d0860d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:31.984441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62fe0c-13d9-4561-8628-2c6c857354b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:31.985124 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62fe0c-13d9-4561-8628-2c6c857354b4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:31.985415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62fe0c-13d9-4561-8628-2c6c857354b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:31.985697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62fe0c-13d9-4561-8628-2c6c857354b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:31.986547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62fe0c-13d9-4561-8628-2c6c857354b4 None admin] RBAC: Adding query filter params (interface=public, service_id=93d3f77695ff47be9bf996fe148104a4, region_id=RegionOne) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:31.986869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62fe0c-13d9-4561-8628-2c6c857354b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:31.988294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62fe0c-13d9-4561-8628-2c6c857354b4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:31.998869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 498/995] 10.222.0.13 () {56 vars in 1251 bytes} [Wed May 25 13:37:31 2022] GET /identity/v3/endpoints?service_id=93d3f77695ff47be9bf996fe148104a4&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:31.999936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:32.105081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc5306-cc28-43b5-853e-72bef991493f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:32.139267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7403d-6aed-4174-9770-c6faee166f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:32.139950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7403d-6aed-4174-9770-c6faee166f38 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:32.140241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7403d-6aed-4174-9770-c6faee166f38 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:32.140526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7403d-6aed-4174-9770-c6faee166f38 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:32.141219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7403d-6aed-4174-9770-c6faee166f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:32.142646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7403d-6aed-4174-9770-c6faee166f38 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:32.149388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 498/996] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:37:31 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:37:32.162282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d7c63-6123-4771-823e-9815cb90b5d3 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:32.162580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d7c63-6123-4771-823e-9815cb90b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:32.162867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d7c63-6123-4771-823e-9815cb90b5d3 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:32.164354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 499/997] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:32.171113 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646993d1-8633-47a6-8ca5-a4225d84542e None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:32.171411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646993d1-8633-47a6-8ca5-a4225d84542e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:32.171686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646993d1-8633-47a6-8ca5-a4225d84542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:32.189596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-646993d1-8633-47a6-8ca5-a4225d84542e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:32.190987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-646993d1-8633-47a6-8ca5-a4225d84542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:32.231975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:32.270738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 499/998] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:32.294431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d7c63-6123-4771-823e-9815cb90b5d3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:32.367745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:32.404958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d7c63-6123-4771-823e-9815cb90b5d3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:32.440009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:32.440956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:32.441364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:32.441762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:32.442518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:32.444079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:32.457031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:32.458274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 13:37:32.459351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:32.466885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 500/999] 10.222.0.13 () {56 vars in 1126 bytes} [Wed May 25 13:37:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:32.468367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646993d1-8633-47a6-8ca5-a4225d84542e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:32.572579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646993d1-8633-47a6-8ca5-a4225d84542e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:32.607087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:32.607928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:32.608317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:32.608696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:32.609501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:32.609937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:32.611421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:32.621021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 500/1000] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:32.622580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:32.726353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9d4d-f4c6-481a-a58c-23c3e89d9511 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:32.755367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:32.762803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ff1dc-3824-4c6d-af93-82ab43fe44b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:32.763816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff1dc-3824-4c6d-af93-82ab43fe44b1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:32.764197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff1dc-3824-4c6d-af93-82ab43fe44b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:32.764572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff1dc-3824-4c6d-af93-82ab43fe44b1 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:32.765385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ff1dc-3824-4c6d-af93-82ab43fe44b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:32.765819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ff1dc-3824-4c6d-af93-82ab43fe44b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:32.767299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ff1dc-3824-4c6d-af93-82ab43fe44b1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:32.777462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 501/1001] 10.222.0.13 () {56 vars in 1122 bytes} [Wed May 25 13:37:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:32.778724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:32.817474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:32.888454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b38d7-f150-4632-83e1-7d61a8abe966 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:32.922577 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0de0-0c6c-4ea0-ab8c-3e8074957747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:32.923250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0de0-0c6c-4ea0-ab8c-3e8074957747 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:32.923541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0de0-0c6c-4ea0-ab8c-3e8074957747 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:32.923826 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0de0-0c6c-4ea0-ab8c-3e8074957747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:32.924569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0de0-0c6c-4ea0-ab8c-3e8074957747 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:32.925980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0de0-0c6c-4ea0-ab8c-3e8074957747 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:32.950179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 501/1002] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:37:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:37:33.211001 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe779f1-7ee3-48ea-b480-3f7f99caea1c None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:33.211541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe779f1-7ee3-48ea-b480-3f7f99caea1c None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:33.211621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe779f1-7ee3-48ea-b480-3f7f99caea1c None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:33.213167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 502/1003] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:33.218292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcfcff-2e79-4ba0-a0ce-35600dabaf84 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:33.218595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcfcff-2e79-4ba0-a0ce-35600dabaf84 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:33.218884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcfcff-2e79-4ba0-a0ce-35600dabaf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:33.236222 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-cadcfcff-2e79-4ba0-a0ce-35600dabaf84 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:33.237413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-cadcfcff-2e79-4ba0-a0ce-35600dabaf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:33.314145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 502/1004] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:33.335993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe779f1-7ee3-48ea-b480-3f7f99caea1c None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:33.443619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe779f1-7ee3-48ea-b480-3f7f99caea1c None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:33.479192 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:33.479908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:33.480199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:33.480479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] PATH_INFO: `/v3/services/image` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:33.481135 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:33.482601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:33.495041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:33.496100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:33.496985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:33.501358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 503/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Wed May 25 13:37:33 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:33.502678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcfcff-2e79-4ba0-a0ce-35600dabaf84 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:33.525425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:33.608639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcfcff-2e79-4ba0-a0ce-35600dabaf84 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:33.643193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c412-28ea-4c39-8054-201b44d85e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:33.643873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c412-28ea-4c39-8054-201b44d85e3f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:33.644164 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c412-28ea-4c39-8054-201b44d85e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:33.644447 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c412-28ea-4c39-8054-201b44d85e3f None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:33.645168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317c412-28ea-4c39-8054-201b44d85e3f None admin] RBAC: Adding query filter params (name=image) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:33.645484 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317c412-28ea-4c39-8054-201b44d85e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:33.646909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317c412-28ea-4c39-8054-201b44d85e3f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:33.657051 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 503/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:33.658235 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:33.719803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:33.762551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d45204-de8d-4db1-987e-81fead9c62e3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:33.808180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b89a0-792d-4917-b9b0-9976c05c8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:33.808880 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b89a0-792d-4917-b9b0-9976c05c8842 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:33.809171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b89a0-792d-4917-b9b0-9976c05c8842 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:33.809456 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b89a0-792d-4917-b9b0-9976c05c8842 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:33.810220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b89a0-792d-4917-b9b0-9976c05c8842 None admin] RBAC: Adding query filter params (type=image) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:33.810537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b89a0-792d-4917-b9b0-9976c05c8842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:33.811939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b89a0-792d-4917-b9b0-9976c05c8842 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:33.825821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 504/1007] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:34.380859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcfdc4-1a69-40d1-82b4-4f6495d94e1e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:34.381381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcfdc4-1a69-40d1-82b4-4f6495d94e1e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:34.381461 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcfdc4-1a69-40d1-82b4-4f6495d94e1e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:34.382961 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 504/1008] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:34.388550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8be03-b36f-4858-830f-095512b38d17 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:34.388961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8be03-b36f-4858-830f-095512b38d17 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:34.389125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8be03-b36f-4858-830f-095512b38d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:34.405894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-5cf8be03-b36f-4858-830f-095512b38d17 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:34.407081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-5cf8be03-b36f-4858-830f-095512b38d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:34.475784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 505/1009] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:34.499150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcfdc4-1a69-40d1-82b4-4f6495d94e1e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:34.588079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:34.606677 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcfdc4-1a69-40d1-82b4-4f6495d94e1e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:34.641541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:34.642292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:34.642580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:34.642858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:34.643506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:34.644877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:34.656733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:34.658059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 13:37:34.658964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:34.662064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 505/1010] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:34.663882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8be03-b36f-4858-830f-095512b38d17 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:34.730423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:34.777177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8be03-b36f-4858-830f-095512b38d17 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:34.815049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:34.815715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:34.815998 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:34.816273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:34.817010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:34.817290 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:34.818682 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:34.828762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 506/1011] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:34.830097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:34.939875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ba48d-ee2c-4282-958b-42fedb777887 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:34.974549 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3ec31-d8a6-4eb6-9057-1253f01263e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:34.975227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3ec31-d8a6-4eb6-9057-1253f01263e5 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:34.975518 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3ec31-d8a6-4eb6-9057-1253f01263e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:34.975803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3ec31-d8a6-4eb6-9057-1253f01263e5 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:34.976583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3ec31-d8a6-4eb6-9057-1253f01263e5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:34.976903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3ec31-d8a6-4eb6-9057-1253f01263e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:34.978886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3ec31-d8a6-4eb6-9057-1253f01263e5 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:34.989189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 506/1012] 10.222.0.13 () {56 vars in 1112 bytes} [Wed May 25 13:37:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:34.990255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:35.094274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ce591-f150-46c6-8484-6f5eaac8e318 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:35.112206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:35.130072 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c4e9c-e19b-4d15-9666-a171bd4a58cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:35.130741 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4e9c-e19b-4d15-9666-a171bd4a58cd None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:35.131033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4e9c-e19b-4d15-9666-a171bd4a58cd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:35.131317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4e9c-e19b-4d15-9666-a171bd4a58cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:35.132072 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c4e9c-e19b-4d15-9666-a171bd4a58cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:35.133445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c4e9c-e19b-4d15-9666-a171bd4a58cd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:35.161767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 507/1013] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:37:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:35.186581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb686c-80b9-48bf-ad7c-839cb9f6d6a9 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:35.186893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb686c-80b9-48bf-ad7c-839cb9f6d6a9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:35.187157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb686c-80b9-48bf-ad7c-839cb9f6d6a9 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:35.188584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 507/1014] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:35.194831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499364c-f6f1-483e-8a3c-de918c730eb9 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:35.195141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499364c-f6f1-483e-8a3c-de918c730eb9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:35.195385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499364c-f6f1-483e-8a3c-de918c730eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:35.213829 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-8499364c-f6f1-483e-8a3c-de918c730eb9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:35.215067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-8499364c-f6f1-483e-8a3c-de918c730eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:35.296062 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 508/1015] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:35.319028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb686c-80b9-48bf-ad7c-839cb9f6d6a9 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:35.335702 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:35.434384 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb686c-80b9-48bf-ad7c-839cb9f6d6a9 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:35.475634 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978becde-e971-49c8-a91f-7ae159b79f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:35.476365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978becde-e971-49c8-a91f-7ae159b79f3a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:35.476655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978becde-e971-49c8-a91f-7ae159b79f3a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:35.476932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978becde-e971-49c8-a91f-7ae159b79f3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:35.478610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978becde-e971-49c8-a91f-7ae159b79f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:35.479629 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978becde-e971-49c8-a91f-7ae159b79f3a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:35.481261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 508/1016] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:35.487947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499364c-f6f1-483e-8a3c-de918c730eb9 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:35.591049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:35.594491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499364c-f6f1-483e-8a3c-de918c730eb9 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:35.630235 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3de5f7-36ae-416b-b8fe-82508b4d3d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:35.630902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de5f7-36ae-416b-b8fe-82508b4d3d7a None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:35.631184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de5f7-36ae-416b-b8fe-82508b4d3d7a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:35.631455 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de5f7-36ae-416b-b8fe-82508b4d3d7a None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:35.632172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3de5f7-36ae-416b-b8fe-82508b4d3d7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:35.633613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3de5f7-36ae-416b-b8fe-82508b4d3d7a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:35.665832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 509/1017] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:37:35 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:37:36.042172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130009f-df93-46e3-a842-762942ed8a14 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:36.042529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130009f-df93-46e3-a842-762942ed8a14 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:36.042751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130009f-df93-46e3-a842-762942ed8a14 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:36.044287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 509/1018] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:36.049520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb584d-15ea-4fea-b984-2e57174dd85a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:36.049790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb584d-15ea-4fea-b984-2e57174dd85a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:36.050080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb584d-15ea-4fea-b984-2e57174dd85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:36.067853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-d6cb584d-15ea-4fea-b984-2e57174dd85a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:36.069075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-d6cb584d-15ea-4fea-b984-2e57174dd85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:36.138732 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 510/1019] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:36 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:36.161054 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130009f-df93-46e3-a842-762942ed8a14 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:36.247078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:36.268105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130009f-df93-46e3-a842-762942ed8a14 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:36.303186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043c152-1052-40c2-ba96-d0fcf828067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:36.303784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043c152-1052-40c2-ba96-d0fcf828067e None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:36.304063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043c152-1052-40c2-ba96-d0fcf828067e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:36.304342 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043c152-1052-40c2-ba96-d0fcf828067e None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:36.305073 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043c152-1052-40c2-ba96-d0fcf828067e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:36.307042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043c152-1052-40c2-ba96-d0fcf828067e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:36.329802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 510/1020] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:37:36 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:37.505157 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1cc9-1f85-4415-979b-733c6c11a105 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:37.505708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1cc9-1f85-4415-979b-733c6c11a105 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:37.505708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1cc9-1f85-4415-979b-733c6c11a105 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:37.507163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 511/1021] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:37.512961 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccce9d-53ec-4e0d-bd71-cb6fd064b6b8 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:37.513367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccce9d-53ec-4e0d-bd71-cb6fd064b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:37.513558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccce9d-53ec-4e0d-bd71-cb6fd064b6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:37.530591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-d9ccce9d-53ec-4e0d-bd71-cb6fd064b6b8 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:37.531781 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-d9ccce9d-53ec-4e0d-bd71-cb6fd064b6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:37.606793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 511/1022] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:37.629907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c1cc9-1f85-4415-979b-733c6c11a105 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:37.711686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:37.733561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c1cc9-1f85-4415-979b-733c6c11a105 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:37.771934 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026eb80-a074-4e34-92d3-e2dc340e69c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:37.772669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026eb80-a074-4e34-92d3-e2dc340e69c8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:37.772950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026eb80-a074-4e34-92d3-e2dc340e69c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:37.773223 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026eb80-a074-4e34-92d3-e2dc340e69c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:37.792232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026eb80-a074-4e34-92d3-e2dc340e69c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-c026eb80-a074-4e34-92d3-e2dc340e69c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:37.797620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:37.798658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:37.799524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:37.802058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 512/1023] 10.222.0.13 () {56 vars in 1120 bytes} [Wed May 25 13:37:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:37.804753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccce9d-53ec-4e0d-bd71-cb6fd064b6b8 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:37.873557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:37.912361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccce9d-53ec-4e0d-bd71-cb6fd064b6b8 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:37.937033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5173-95c7-4e61-8c7f-6cb3cab523d9 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:37.937327 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5173-95c7-4e61-8c7f-6cb3cab523d9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:37.937622 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c5173-95c7-4e61-8c7f-6cb3cab523d9 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:37.939165 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 513/1024] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:37.944236 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed453-6c3e-4660-95c9-21bc40d9c679 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:37.944470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed453-6c3e-4660-95c9-21bc40d9c679 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:37.944746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed453-6c3e-4660-95c9-21bc40d9c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:37.948536 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:37.949224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:37.949517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:37.949887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:37.950858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:37.951174 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:37.953505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:37.962793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-7e6ed453-6c3e-4660-95c9-21bc40d9c679 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:37.967655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 512/1025] 10.222.0.13 () {56 vars in 1115 bytes} [Wed May 25 13:37:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:37.967771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-7e6ed453-6c3e-4660-95c9-21bc40d9c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:37.968453 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.037676 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 514/1026] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:38.062377 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ed453-6c3e-4660-95c9-21bc40d9c679 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.081012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4001-27a0-4be4-9be5-5fcb9bc1fde8 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:38.110169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:38.121548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:38.122496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.122876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.123250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.135594 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:38.137192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:38.140152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:38.154667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:38.155828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:38.157041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:38.157041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:38.157041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:38.157041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:38.157041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 513/1027] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:38.161430 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.179283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ed453-6c3e-4660-95c9-21bc40d9c679 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:38.216233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517e4c1-531d-4bfb-968a-496ea4efae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:38.217185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517e4c1-531d-4bfb-968a-496ea4efae34 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.217562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517e4c1-531d-4bfb-968a-496ea4efae34 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.217993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517e4c1-531d-4bfb-968a-496ea4efae34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.219266 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517e4c1-531d-4bfb-968a-496ea4efae34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:38.220801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517e4c1-531d-4bfb-968a-496ea4efae34 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:38.222616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 515/1028] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:38.228091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517e4c1-531d-4bfb-968a-496ea4efae34 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.274169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67557e56-a6a6-46ed-95c0-9ae51b9e4c95 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:38.311734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:38.312320 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.312607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.312897 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.313616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:38.313955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:38.315341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:38.327866 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 514/1029] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:38.333630 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.336297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517e4c1-531d-4bfb-968a-496ea4efae34 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:38.375385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83c94f-0857-46f5-a352-7c611f3a84dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:38.376081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c94f-0857-46f5-a352-7c611f3a84dd None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.376370 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c94f-0857-46f5-a352-7c611f3a84dd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.376651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c94f-0857-46f5-a352-7c611f3a84dd None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.377391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83c94f-0857-46f5-a352-7c611f3a84dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:38.378943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83c94f-0857-46f5-a352-7c611f3a84dd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:38.381081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:38.390700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:38.413986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 516/1030] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:37:38 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:38.454795 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e505b1f-e860-4167-9403-81962bb82772 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:38.501376 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e21b1-8dd5-46a2-bd0d-823b9933c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:38.502591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e21b1-8dd5-46a2-bd0d-823b9933c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.503085 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e21b1-8dd5-46a2-bd0d-823b9933c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.503544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e21b1-8dd5-46a2-bd0d-823b9933c5e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.513325 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e21b1-8dd5-46a2-bd0d-823b9933c5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:38.514856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e21b1-8dd5-46a2-bd0d-823b9933c5e4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-532e21b1-8dd5-46a2-bd0d-823b9933c5e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:38.530598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:38.531662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:38.537460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 515/1031] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:37:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:38.539728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83c94f-0857-46f5-a352-7c611f3a84dd None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.568235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b1637-d4f2-4176-b5ba-af8f28cc4dfd None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.568427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b1637-d4f2-4176-b5ba-af8f28cc4dfd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.568721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b1637-d4f2-4176-b5ba-af8f28cc4dfd None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.570189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 516/1032] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:38.575923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7e87-1641-4412-91b1-55aa6a45f6ee None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.576232 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7e87-1641-4412-91b1-55aa6a45f6ee None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.576486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb7e87-1641-4412-91b1-55aa6a45f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.595607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-dffb7e87-1641-4412-91b1-55aa6a45f6ee None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:38.596823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-dffb7e87-1641-4412-91b1-55aa6a45f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:38.673446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83c94f-0857-46f5-a352-7c611f3a84dd None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:38.679573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 517/1033] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:38.702305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb7e87-1641-4412-91b1-55aa6a45f6ee None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.715509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:38.716421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.716710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.716988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.718005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:38.718300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:38.719866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:38.734363 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:38.740157 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 517/1034] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:37:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:38.746746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.810134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:38.818832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb7e87-1641-4412-91b1-55aa6a45f6ee None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:38.857347 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:38.858177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.858460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.858656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12afd-53cc-4fbf-a530-f6b25f21dd3e None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:38.858764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] PATH_INFO: `/v3/services/image` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.859400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:38.860792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:38.872576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:38.873622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:38.874564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 518/1035] 10.222.0.13 () {56 vars in 1105 bytes} [Wed May 25 13:37:38 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:38.879989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:38.896428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77798a16-e10b-4564-b598-145a9310c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:38.897194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77798a16-e10b-4564-b598-145a9310c996 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:38.897485 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77798a16-e10b-4564-b598-145a9310c996 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:38.897785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77798a16-e10b-4564-b598-145a9310c996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:38.967185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77798a16-e10b-4564-b598-145a9310c996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:38.968645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77798a16-e10b-4564-b598-145a9310c996 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:38.985883 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:38.993709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e45e-8ee8-49f1-b8b8-cad124c958a7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.025855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:39.031653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.032480 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.032770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.033107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.033778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] RBAC: Adding query filter params (name=image) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:39.034254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.035487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.041418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 519/1036] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:39.046833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:39.080434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 518/1037] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:37:39.081418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77798a16-e10b-4564-b598-145a9310c996 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:39.156590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267bc43-7642-4e72-970f-da5637ac7016 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.185522 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77798a16-e10b-4564-b598-145a9310c996 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.199041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.200061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.200872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.201559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.202456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] RBAC: Adding query filter params (type=image) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:39.203072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.204902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.212509 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 520/1038] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:39.218216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:39.220884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.221684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.222000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.222278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.232713 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.234218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.248314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:39.252019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:39.253353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:39.254611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:39.254611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:39.254611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:39.254611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:39.254611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 519/1039] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:39.259716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:39.269124 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:39.334932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2b40a-97f1-4337-8271-dce6157c128c None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.369994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8337be4-de63-478f-83d3-ca44bede3504 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.375238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.375906 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.376199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.376482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.377327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] RBAC: Adding query filter params (interface=public, service_id=987a201ebd424a66a2d14434cec703d2, region_id=RegionOne) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:39.377648 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.379516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.391077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 521/1040] 10.222.0.13 () {56 vars in 1251 bytes} [Wed May 25 13:37:39 2022] GET /identity/v3/endpoints?service_id=987a201ebd424a66a2d14434cec703d2&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:39.392789 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:39.408847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.409508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.409916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.410117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.410839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:39.411167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.412530 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.424282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 520/1041] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:39.429722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:39.490652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:39.500168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:39.509337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e80b2-f151-4534-a51c-307765f44072 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.542337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2f7f3-2839-4479-afa0-733a607edf2a None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.543435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e8708-f8eb-4996-ba6e-8bb40a469c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.544168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e8708-f8eb-4996-ba6e-8bb40a469c6e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.544459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e8708-f8eb-4996-ba6e-8bb40a469c6e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.544775 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e8708-f8eb-4996-ba6e-8bb40a469c6e None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.545469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e8708-f8eb-4996-ba6e-8bb40a469c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.546896 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e8708-f8eb-4996-ba6e-8bb40a469c6e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.553643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 522/1042] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:37:39 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:37:39.583388 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.584681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.585219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.585707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.594785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.596635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:39.612716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:39.613697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:39.614739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:39.614739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:39.614739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:39.614739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:39.614739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:39.614739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:39.614739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:39.614739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:39.620709 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 521/1043] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:39.621744 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e8708-f8eb-4996-ba6e-8bb40a469c6e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:39.738244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e8708-f8eb-4996-ba6e-8bb40a469c6e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.775022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df16a48-497d-4ccf-8254-aeb3c3279f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.775698 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df16a48-497d-4ccf-8254-aeb3c3279f85 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.775986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df16a48-497d-4ccf-8254-aeb3c3279f85 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.776267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df16a48-497d-4ccf-8254-aeb3c3279f85 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.777055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df16a48-497d-4ccf-8254-aeb3c3279f85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:39.777369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df16a48-497d-4ccf-8254-aeb3c3279f85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.778874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df16a48-497d-4ccf-8254-aeb3c3279f85 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.794595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 523/1044] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:39.800120 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:39.902609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ae238-9ab7-465d-a7fd-2f01245d710b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:39.930240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:39.940816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bce7c-c23d-4b7a-af1e-630c950f630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:39.941491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bce7c-c23d-4b7a-af1e-630c950f630c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:39.941802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bce7c-c23d-4b7a-af1e-630c950f630c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:39.942080 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bce7c-c23d-4b7a-af1e-630c950f630c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:39.942934 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bce7c-c23d-4b7a-af1e-630c950f630c None admin] RBAC: Adding query filter params (role.id=567960a6d9004ce3a62daa2a63414d13, scope.project.id=c0b98559906540c082df06432223b497, user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:39.943251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bce7c-c23d-4b7a-af1e-630c950f630c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:39.944704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bce7c-c23d-4b7a-af1e-630c950f630c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:39.951251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 522/1045] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:39 2022] GET /identity/v3/role_assignments?user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c&scope.project.id=c0b98559906540c082df06432223b497&role.id=567960a6d9004ce3a62daa2a63414d13 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:40.689441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc292e24-5acd-4b6d-8654-d0998d1302af None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:40.690096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc292e24-5acd-4b6d-8654-d0998d1302af None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:40.690096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc292e24-5acd-4b6d-8654-d0998d1302af None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:40.691481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 524/1046] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:40.697473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b5c1-b1de-4097-8db3-7498556a154a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:40.697974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b5c1-b1de-4097-8db3-7498556a154a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:40.698085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b5c1-b1de-4097-8db3-7498556a154a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:40.716749 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-60d2b5c1-b1de-4097-8db3-7498556a154a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:40.718420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-60d2b5c1-b1de-4097-8db3-7498556a154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:40.805779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 523/1047] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:40.830123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc292e24-5acd-4b6d-8654-d0998d1302af None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:40.845235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:40.958098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc292e24-5acd-4b6d-8654-d0998d1302af None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:41.005043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3bbc-3e2b-425c-91ca-d24eb907b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:41.005911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3bbc-3e2b-425c-91ca-d24eb907b6fe None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:41.006206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3bbc-3e2b-425c-91ca-d24eb907b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:41.006492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3bbc-3e2b-425c-91ca-d24eb907b6fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:41.019852 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f3bbc-3e2b-425c-91ca-d24eb907b6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-5d2f3bbc-3e2b-425c-91ca-d24eb907b6fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:41.027667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:41.028654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:41.034791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 525/1048] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:41.036852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2b5c1-b1de-4097-8db3-7498556a154a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:41.157893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2b5c1-b1de-4097-8db3-7498556a154a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:41.181215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:41.197664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:41.198377 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:41.198671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:41.198954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:41.199715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:41.200025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:41.201422 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:41.213156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 524/1049] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:41.217254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3bbc-3e2b-425c-91ca-d24eb907b6fe None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:41.320153 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:41.360085 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3bbc-3e2b-425c-91ca-d24eb907b6fe None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:41.395892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0f12-e8f5-4f53-8c09-5083dcda90be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:41.396776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0f12-e8f5-4f53-8c09-5083dcda90be None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:41.397068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0f12-e8f5-4f53-8c09-5083dcda90be None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:41.397350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0f12-e8f5-4f53-8c09-5083dcda90be None admin] PATH_INFO: `/v3/users/563eb02db8774ba382cc3fa3c275e80a` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:41.411829 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0f12-e8f5-4f53-8c09-5083dcda90be None admin] RBAC: Authorizing `identity:get_user(user_id=563eb02db8774ba382cc3fa3c275e80a)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:41.413324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0f12-e8f5-4f53-8c09-5083dcda90be None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:41.417914 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 526/1050] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:37:41 2022] GET /identity/v3/users/563eb02db8774ba382cc3fa3c275e80a => generated 285 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:41.421401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:41.545145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2cb12-70ac-44b3-bd3e-323fe8f94ba8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:41.580964 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60352b-fd75-4cf9-a422-e96ad08a6aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:41.581630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60352b-fd75-4cf9-a422-e96ad08a6aa4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:41.581952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60352b-fd75-4cf9-a422-e96ad08a6aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:41.582232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60352b-fd75-4cf9-a422-e96ad08a6aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:41.645126 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:41.670345 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60352b-fd75-4cf9-a422-e96ad08a6aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:41.672170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60352b-fd75-4cf9-a422-e96ad08a6aa4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:41.794203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 525/1051] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:37:41.795697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884099-f4f0-414b-9f17-066dab5fa531 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:41.796082 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884099-f4f0-414b-9f17-066dab5fa531 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:41.796194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884099-f4f0-414b-9f17-066dab5fa531 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:41.796788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60352b-fd75-4cf9-a422-e96ad08a6aa4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:41.799256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 527/1052] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:41.803241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6990-d04f-4cc1-b9bb-b214d8bf7371 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:41.803522 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6990-d04f-4cc1-b9bb-b214d8bf7371 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:41.803798 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6990-d04f-4cc1-b9bb-b214d8bf7371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:41.821649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-25bd6990-d04f-4cc1-b9bb-b214d8bf7371 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:41.822874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-25bd6990-d04f-4cc1-b9bb-b214d8bf7371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:41.890524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:41.900327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 528/1053] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:41.919666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60352b-fd75-4cf9-a422-e96ad08a6aa4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:41.923678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6990-d04f-4cc1-b9bb-b214d8bf7371 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:41.962444 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d301d47-d38a-421a-96c5-b87b9b33e306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:41.963446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301d47-d38a-421a-96c5-b87b9b33e306 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:41.963733 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301d47-d38a-421a-96c5-b87b9b33e306 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:41.964010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d301d47-d38a-421a-96c5-b87b9b33e306 None admin] PATH_INFO: `/v3/projects/e75e4e20ff744572ab252da83adb8899` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:41.965401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d301d47-d38a-421a-96c5-b87b9b33e306 None admin] RBAC: Authorizing `identity:get_project(project_id=e75e4e20ff744572ab252da83adb8899)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:41.966940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d301d47-d38a-421a-96c5-b87b9b33e306 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:41.974340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 526/1054] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:37:41 2022] GET /identity/v3/projects/e75e4e20ff744572ab252da83adb8899 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:41.975642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d301d47-d38a-421a-96c5-b87b9b33e306 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:42.001143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:42.050251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6990-d04f-4cc1-b9bb-b214d8bf7371 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:42.090422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:42.091221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.091511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.091789 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] PATH_INFO: `/v3/services/image` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.092445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:42.093871 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:42.106010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:42.107094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:42.110771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 529/1055] 10.222.0.13 () {56 vars in 1105 bytes} [Wed May 25 13:37:41 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:42.112899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d301d47-d38a-421a-96c5-b87b9b33e306 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:42.115025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:42.153803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bd29c-86b7-4164-bb01-2bbf4910dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:42.154481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd29c-86b7-4164-bb01-2bbf4910dd6f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.154768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd29c-86b7-4164-bb01-2bbf4910dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.155046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd29c-86b7-4164-bb01-2bbf4910dd6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.155885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bd29c-86b7-4164-bb01-2bbf4910dd6f None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=e75e4e20ff744572ab252da83adb8899, user.id=563eb02db8774ba382cc3fa3c275e80a) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:42.156202 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bd29c-86b7-4164-bb01-2bbf4910dd6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:42.157642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bd29c-86b7-4164-bb01-2bbf4910dd6f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:42.163688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 527/1056] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:41 2022] GET /identity/v3/role_assignments?user.id=563eb02db8774ba382cc3fa3c275e80a&scope.project.id=e75e4e20ff744572ab252da83adb8899&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:42.164876 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b61e96-76e1-48ad-bab9-bd851fea15c8 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.165166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b61e96-76e1-48ad-bab9-bd851fea15c8 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.165447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b61e96-76e1-48ad-bab9-bd851fea15c8 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.166919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 528/1057] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:42.172452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb750d-71fc-498e-9bca-e748bd05a2e3 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.172746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb750d-71fc-498e-9bca-e748bd05a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.173027 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb750d-71fc-498e-9bca-e748bd05a2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.191536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-6afb750d-71fc-498e-9bca-e748bd05a2e3 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:42.192823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-6afb750d-71fc-498e-9bca-e748bd05a2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:42.204973 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:42.240910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d733-891e-4e62-8ebf-0c7121332a2e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:42.268206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:42.285637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 529/1058] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:42.290203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:42.291664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.292358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.293099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.294672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:42.295459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:42.298212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:42.303939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb750d-71fc-498e-9bca-e748bd05a2e3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:42.307807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 530/1059] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:42.314798 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:42.452529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc5008-6dc8-4ac5-876c-6036b59333e7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:42.453457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb750d-71fc-498e-9bca-e748bd05a2e3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:42.497285 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd2f7f-4685-4f13-9637-5a2a5e983c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:42.498238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:42.498578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2f7f-4685-4f13-9637-5a2a5e983c1d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.498912 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.499198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.499330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2f7f-4685-4f13-9637-5a2a5e983c1d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.499473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.499877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2f7f-4685-4f13-9637-5a2a5e983c1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.500187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] RBAC: Adding query filter params (type=image) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:42.500494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:42.501921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:42.507769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 531/1060] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:42.513617 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd2f7f-4685-4f13-9637-5a2a5e983c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:42.514792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-eedd2f7f-4685-4f13-9637-5a2a5e983c1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:42.524450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:42.525468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:42.527532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 530/1061] 10.222.0.13 () {56 vars in 1120 bytes} [Wed May 25 13:37:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:42.531642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd2f7f-4685-4f13-9637-5a2a5e983c1d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:42.535346 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:42.591534 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:42.662613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0e7e1-5637-4982-86d0-1b0bb9c984bf None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:42.675079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd2f7f-4685-4f13-9637-5a2a5e983c1d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:42.704288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41805a4-2c3e-4047-a338-ca55adcc65d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:42.705229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41805a4-2c3e-4047-a338-ca55adcc65d9 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.705725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41805a4-2c3e-4047-a338-ca55adcc65d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.706030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41805a4-2c3e-4047-a338-ca55adcc65d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.706782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41805a4-2c3e-4047-a338-ca55adcc65d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:42.708203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41805a4-2c3e-4047-a338-ca55adcc65d9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:42.727798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:42.728476 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.728764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.729048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.729840 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:42.730156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:42.731544 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:42.735388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 532/1062] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:37:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:37:42.747256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 531/1063] 10.222.0.13 () {56 vars in 1115 bytes} [Wed May 25 13:37:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:42.753614 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41805a4-2c3e-4047-a338-ca55adcc65d9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:42.889818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41805a4-2c3e-4047-a338-ca55adcc65d9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:42.890910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:42.936456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:42.937458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:42.937566 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:42.937956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:42.950350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:42.951858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:42.971385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:42.972558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:42.973704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:42.973704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:42.973704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:42.973704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:42.973704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 533/1064] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:42.980549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:43.073559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:43.114233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bc031-247e-4ca9-b934-91449113a70b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:43.148741 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:43.149914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:43.150206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:43.150486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:43.151223 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:43.151537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:43.152921 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:43.166234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 532/1065] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:43.171585 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:43.275067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac28a45-e4f8-4492-9977-15778582404a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:43.312309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:43.313115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:43.313399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:43.313676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:43.322008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:43.323446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:43.338915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:43.339977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:43.340963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:43.345765 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 534/1066] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:37:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:43.345977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:43.449091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0483a7-cc62-4762-81aa-9c8ed80b680c None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:43.474993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:43.485548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:43.486361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:43.486653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:43.487052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:43.488109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:43.488441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:43.490047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:43.511907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 533/1067] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:37:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:43.513423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:43.530823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:43.618947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a26f82-db58-4abb-9bde-836cc87bb486 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:43.654863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:43.655663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:43.655951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:43.656228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:43.667104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:43.668674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:43.686716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:43.687693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:43.688619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:43.688619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:43.688619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:43.688619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:43.689818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 535/1068] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:43.693643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:43.801514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64aa8-be96-4965-ac14-c9642c7bffb8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:43.837890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:43.838562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:43.838846 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:43.839122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:43.839849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:43.840159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:43.841536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:43.857889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 534/1069] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:43.860249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:43.931601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:43.970953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76c374-cfc7-4151-a817-96181feefadc None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:44.017370 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48745732-780e-4617-9314-838338ac12c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:44.018233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48745732-780e-4617-9314-838338ac12c4 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:44.018517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48745732-780e-4617-9314-838338ac12c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:44.018792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48745732-780e-4617-9314-838338ac12c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:44.030105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48745732-780e-4617-9314-838338ac12c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:44.032776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48745732-780e-4617-9314-838338ac12c4 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-48745732-780e-4617-9314-838338ac12c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:44.060508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:44.061465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:44.062475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:44.062475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:44.062475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:44.062475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:44.062475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:44.062475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:44.062475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:44.062475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:44.067644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 536/1070] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:44.069199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:44.136189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:44.193391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d0e4a-3a4b-4b1c-a7e5-a37366cc29f1 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:44.232881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e888-fa9e-4402-9c9d-cee86d1b6f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:44.233541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e888-fa9e-4402-9c9d-cee86d1b6f95 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:44.233864 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e888-fa9e-4402-9c9d-cee86d1b6f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:44.234148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e888-fa9e-4402-9c9d-cee86d1b6f95 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:44.234938 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e888-fa9e-4402-9c9d-cee86d1b6f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:44.235248 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e888-fa9e-4402-9c9d-cee86d1b6f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:44.236690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e888-fa9e-4402-9c9d-cee86d1b6f95 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:44.253953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 535/1071] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:44.255507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48745732-780e-4617-9314-838338ac12c4 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:44.360027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48745732-780e-4617-9314-838338ac12c4 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:44.387081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860551aa-9810-4df4-991b-893bdb2999c6 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:44.387384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860551aa-9810-4df4-991b-893bdb2999c6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:44.387816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860551aa-9810-4df4-991b-893bdb2999c6 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:44.389291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 536/1072] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:44.389622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:44.395620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a648f36-2615-4982-abc8-b80d554e8b37 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:44.396041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a648f36-2615-4982-abc8-b80d554e8b37 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:44.396460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a648f36-2615-4982-abc8-b80d554e8b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:44.398963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43315e90-b119-499f-af76-860a2d55ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:44.401845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315e90-b119-499f-af76-860a2d55ad66 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:44.402499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315e90-b119-499f-af76-860a2d55ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:44.403200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315e90-b119-499f-af76-860a2d55ad66 None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/7ac29fbb131c4ccf9ee7f26c4bd6523c/roles/567960a6d9004ce3a62daa2a63414d13` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:44.405437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43315e90-b119-499f-af76-860a2d55ad66 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=7ac29fbb131c4ccf9ee7f26c4bd6523c, role_id=567960a6d9004ce3a62daa2a63414d13)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:44.406939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43315e90-b119-499f-af76-860a2d55ad66 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:44.423886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 537/1073] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:37:44 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/7ac29fbb131c4ccf9ee7f26c4bd6523c/roles/567960a6d9004ce3a62daa2a63414d13 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:37:44.425434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9a648f36-2615-4982-abc8-b80d554e8b37 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:44.426977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9a648f36-2615-4982-abc8-b80d554e8b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:44.517773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 537/1074] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:44.537508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43315e90-b119-499f-af76-860a2d55ad66 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:44.657194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43315e90-b119-499f-af76-860a2d55ad66 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:44.704226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be23aa-3396-41c2-ab1f-4cbc14dd9b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:44.705031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be23aa-3396-41c2-ab1f-4cbc14dd9b45 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:44.705315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be23aa-3396-41c2-ab1f-4cbc14dd9b45 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:44.705590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be23aa-3396-41c2-ab1f-4cbc14dd9b45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:44.717464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be23aa-3396-41c2-ab1f-4cbc14dd9b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-c6be23aa-3396-41c2-ab1f-4cbc14dd9b45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:44.725362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:44.726493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:44.728002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 538/1075] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:44.733489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a648f36-2615-4982-abc8-b80d554e8b37 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:44.768100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:44.842276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a648f36-2615-4982-abc8-b80d554e8b37 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:44.879738 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:44.880597 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:44.880984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:44.881383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:44.882319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:44.882738 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:44.884342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:44.897850 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 538/1076] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:44.900961 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be23aa-3396-41c2-ab1f-4cbc14dd9b45 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:44.950285 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:45.007906 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be23aa-3396-41c2-ab1f-4cbc14dd9b45 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:45.044407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a4deb-e42b-4c0c-a536-4e823b5a1049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:45.045304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4deb-e42b-4c0c-a536-4e823b5a1049 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:45.045587 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4deb-e42b-4c0c-a536-4e823b5a1049 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:45.045893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a4deb-e42b-4c0c-a536-4e823b5a1049 None admin] PATH_INFO: `/v3/users/563eb02db8774ba382cc3fa3c275e80a` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:45.047142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a4deb-e42b-4c0c-a536-4e823b5a1049 None admin] RBAC: Authorizing `identity:get_user(user_id=563eb02db8774ba382cc3fa3c275e80a)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:45.048598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a4deb-e42b-4c0c-a536-4e823b5a1049 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:45.051445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 539/1077] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:37:44 2022] GET /identity/v3/users/563eb02db8774ba382cc3fa3c275e80a => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:45.056078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:45.069074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cfe48-e527-4468-96f1-3e1f4b898c92 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:45.069510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cfe48-e527-4468-96f1-3e1f4b898c92 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:45.069821 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cfe48-e527-4468-96f1-3e1f4b898c92 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:45.071762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 540/1078] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:45.077625 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5e3b-eff9-45bf-a12c-16b03352cb4b None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:45.078055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5e3b-eff9-45bf-a12c-16b03352cb4b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:45.078339 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5e3b-eff9-45bf-a12c-16b03352cb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:45.096376 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-cfef5e3b-eff9-45bf-a12c-16b03352cb4b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:45.097597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-cfef5e3b-eff9-45bf-a12c-16b03352cb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:45.160712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:45.169521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a14030-3066-4bfe-832c-6fa71c03cb0f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:45.173406 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 541/1079] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:45.195638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef5e3b-eff9-45bf-a12c-16b03352cb4b None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:45.205701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436c332-ffcf-43ab-bd87-7bd73b00e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:45.206529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436c332-ffcf-43ab-bd87-7bd73b00e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:45.206812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436c332-ffcf-43ab-bd87-7bd73b00e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:45.207088 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436c332-ffcf-43ab-bd87-7bd73b00e9e8 None admin] PATH_INFO: `/v3/projects/e75e4e20ff744572ab252da83adb8899` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:45.208328 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436c332-ffcf-43ab-bd87-7bd73b00e9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e75e4e20ff744572ab252da83adb8899)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:45.209819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436c332-ffcf-43ab-bd87-7bd73b00e9e8 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:45.217041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 539/1080] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:37:45 2022] GET /identity/v3/projects/e75e4e20ff744572ab252da83adb8899 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:45.218135 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436c332-ffcf-43ab-bd87-7bd73b00e9e8 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:45.249225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:45.306246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef5e3b-eff9-45bf-a12c-16b03352cb4b None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:45.341481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436c332-ffcf-43ab-bd87-7bd73b00e9e8 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:45.345559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9172-4272-4302-8ff5-164fa479eb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:45.346270 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9172-4272-4302-8ff5-164fa479eb35 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:45.346557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9172-4272-4302-8ff5-164fa479eb35 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:45.346833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9172-4272-4302-8ff5-164fa479eb35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:45.378541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f75b-cb2a-4caa-a29a-7b3bddc5a219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:45.379493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f75b-cb2a-4caa-a29a-7b3bddc5a219 None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:45.379791 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f75b-cb2a-4caa-a29a-7b3bddc5a219 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:45.380071 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f75b-cb2a-4caa-a29a-7b3bddc5a219 None admin] PATH_INFO: `/v3/projects/e75e4e20ff744572ab252da83adb8899/users/563eb02db8774ba382cc3fa3c275e80a/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:45.382275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635f75b-cb2a-4caa-a29a-7b3bddc5a219 None admin] RBAC: Authorizing `identity:create_grant(project_id=e75e4e20ff744572ab252da83adb8899, user_id=563eb02db8774ba382cc3fa3c275e80a, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:45.384614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635f75b-cb2a-4caa-a29a-7b3bddc5a219 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:45.400892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 540/1081] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:37:45 2022] PUT /identity/v3/projects/e75e4e20ff744572ab252da83adb8899/users/563eb02db8774ba382cc3fa3c275e80a/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:37:45.440187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e9172-4272-4302-8ff5-164fa479eb35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:45.442059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e9172-4272-4302-8ff5-164fa479eb35 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:45.526815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:45.592087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 542/1082] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:37:45.598267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f75b-cb2a-4caa-a29a-7b3bddc5a219 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:45.628420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:45.707817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f75b-cb2a-4caa-a29a-7b3bddc5a219 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:45.743746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248be58-6e99-44c2-8de9-020a79b46ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:45.744543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248be58-6e99-44c2-8de9-020a79b46ac9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:45.744829 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248be58-6e99-44c2-8de9-020a79b46ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:45.745109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248be58-6e99-44c2-8de9-020a79b46ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:45.756071 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248be58-6e99-44c2-8de9-020a79b46ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:45.757547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248be58-6e99-44c2-8de9-020a79b46ac9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-e248be58-6e99-44c2-8de9-020a79b46ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:45.775714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:45.776999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:45.778257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:45.778257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:45.778257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:45.778257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:45.778257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 541/1083] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:45.784977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9172-4272-4302-8ff5-164fa479eb35 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:45.895891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9172-4272-4302-8ff5-164fa479eb35 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:45.931802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980a9e4-5a3f-4a1c-8a58-7edd9fa47cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:45.932628 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980a9e4-5a3f-4a1c-8a58-7edd9fa47cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:45.933022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980a9e4-5a3f-4a1c-8a58-7edd9fa47cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:45.933405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980a9e4-5a3f-4a1c-8a58-7edd9fa47cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:45.934277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980a9e4-5a3f-4a1c-8a58-7edd9fa47cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:45.934692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980a9e4-5a3f-4a1c-8a58-7edd9fa47cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:45.936172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980a9e4-5a3f-4a1c-8a58-7edd9fa47cd2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:45.953782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 543/1084] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:46.694999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261569-57ac-45fd-abc9-536e040c40b1 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:46.695560 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261569-57ac-45fd-abc9-536e040c40b1 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:46.695560 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261569-57ac-45fd-abc9-536e040c40b1 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:46.696981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 542/1085] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:46.702245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723c17-f0b3-4f8c-af65-a12258ad339c None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:46.702612 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723c17-f0b3-4f8c-af65-a12258ad339c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:46.702967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723c17-f0b3-4f8c-af65-a12258ad339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:46.708966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:46.720599 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-71723c17-f0b3-4f8c-af65-a12258ad339c None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:46.721860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-71723c17-f0b3-4f8c-af65-a12258ad339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:46.788326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 544/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:46.812801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261569-57ac-45fd-abc9-536e040c40b1 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:46.890152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:46.913983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261569-57ac-45fd-abc9-536e040c40b1 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:46.947126 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a07e-b762-495b-98d4-bef653d87f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:46.947856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a07e-b762-495b-98d4-bef653d87f59 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:46.948142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a07e-b762-495b-98d4-bef653d87f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:46.948420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a07e-b762-495b-98d4-bef653d87f59 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:46.959085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2a07e-b762-495b-98d4-bef653d87f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-14e2a07e-b762-495b-98d4-bef653d87f59 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:46.967993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:46.969138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:46.970442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 543/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Wed May 25 13:37:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:37:46.975145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71723c17-f0b3-4f8c-af65-a12258ad339c None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:47.074555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71723c17-f0b3-4f8c-af65-a12258ad339c None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:47.109390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:47.110114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.110407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.110690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.111443 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:47.111758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:47.113146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:47.114619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:47.122515 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 545/1088] 10.222.0.13 () {56 vars in 1115 bytes} [Wed May 25 13:37:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:47.128182 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a07e-b762-495b-98d4-bef653d87f59 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:47.229070 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a07e-b762-495b-98d4-bef653d87f59 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:47.262518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:47.263313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.263609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.263888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.266684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:47.276100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:47.277565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:47.295728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:47.296812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:47.297903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:47.297903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:47.297903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:47.297903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:47.297903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 544/1089] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:47.302709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:47.405259 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701507e8-591d-4e2a-9e83-d171d9fa904a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:47.439154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:47.439820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.440108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.440390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.441107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:47.441418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:47.442864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:47.455502 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 546/1090] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:47.461790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:47.566102 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad203ea-7b36-4d10-98cb-64e51493ddfb None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:47.601680 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc7943-1d58-4ae1-a77a-0df9141be4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:47.603019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7943-1d58-4ae1-a77a-0df9141be4fd None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.603310 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7943-1d58-4ae1-a77a-0df9141be4fd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.603592 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7943-1d58-4ae1-a77a-0df9141be4fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.611435 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc7943-1d58-4ae1-a77a-0df9141be4fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:47.612887 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc7943-1d58-4ae1-a77a-0df9141be4fd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-36bc7943-1d58-4ae1-a77a-0df9141be4fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:37:47.627446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:47.628630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:47.629636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 545/1091] 10.222.0.13 () {56 vars in 1093 bytes} [Wed May 25 13:37:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:47.634441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:47.653366 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494dff-d8bf-4e93-ac3e-caafa02322df None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.653711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494dff-d8bf-4e93-ac3e-caafa02322df None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.654045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494dff-d8bf-4e93-ac3e-caafa02322df None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.655428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 546/1092] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:47.660504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1135-7b46-4c85-8212-2cdfa8abb621 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.660790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1135-7b46-4c85-8212-2cdfa8abb621 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.661074 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1135-7b46-4c85-8212-2cdfa8abb621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.678253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-057b1135-7b46-4c85-8212-2cdfa8abb621 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:47.679461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-057b1135-7b46-4c85-8212-2cdfa8abb621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:47.693491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:47.724263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:47.739288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31570c30-bb9c-4821-8790-dee2c26b8b25 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:47.753049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 547/1093] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:47.774838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:47.775505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.775790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.776065 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.776905 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:47.777006 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1135-7b46-4c85-8212-2cdfa8abb621 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:47.777216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:47.778703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:47.797339 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 547/1094] 10.222.0.13 () {56 vars in 1133 bytes} [Wed May 25 13:37:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:47.802984 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:47.884837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1135-7b46-4c85-8212-2cdfa8abb621 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:47.900902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c5b7f-e02c-4bef-949e-4e375079b7da None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:47.916252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:47.919362 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d90ac-da31-4ac2-8659-47a7f401e6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:47.920168 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d90ac-da31-4ac2-8659-47a7f401e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.920610 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d90ac-da31-4ac2-8659-47a7f401e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.920745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d90ac-da31-4ac2-8659-47a7f401e6b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.931009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d90ac-da31-4ac2-8659-47a7f401e6b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:37:47.937127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272cde-08d2-4dd4-8f0e-bec5be722fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:47.937806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272cde-08d2-4dd4-8f0e-bec5be722fee None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:47.938094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272cde-08d2-4dd4-8f0e-bec5be722fee None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:47.938373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272cde-08d2-4dd4-8f0e-bec5be722fee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-f30d90ac-da31-4ac2-8659-47a7f401e6b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:37:47.938639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:47.939630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:37:47.940668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 548/1095] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:47.945832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d90ac-da31-4ac2-8659-47a7f401e6b0 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:47.986546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.007286 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6272cde-08d2-4dd4-8f0e-bec5be722fee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.008766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6272cde-08d2-4dd4-8f0e-bec5be722fee None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.047269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d90ac-da31-4ac2-8659-47a7f401e6b0 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.080495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.081167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.081457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.081764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.082526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:48.082841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.084230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.093301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 549/1096] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:37:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:48.099060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.110574 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 548/1097] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:37:48.116309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272cde-08d2-4dd4-8f0e-bec5be722fee None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.130664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.194750 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.198703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f80e5d-f274-42af-ab7f-4d74eac8a862 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.216628 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272cde-08d2-4dd4-8f0e-bec5be722fee None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.234693 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577871-2235-46e7-8fb5-cda67000f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.235573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577871-2235-46e7-8fb5-cda67000f042 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.235858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577871-2235-46e7-8fb5-cda67000f042 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.236137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26577871-2235-46e7-8fb5-cda67000f042 None admin] PATH_INFO: `/v3/users/563eb02db8774ba382cc3fa3c275e80a` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.237359 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26577871-2235-46e7-8fb5-cda67000f042 None admin] RBAC: Authorizing `identity:get_user(user_id=563eb02db8774ba382cc3fa3c275e80a)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.238852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26577871-2235-46e7-8fb5-cda67000f042 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.240525 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 550/1098] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/users/563eb02db8774ba382cc3fa3c275e80a => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:48.246191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577871-2235-46e7-8fb5-cda67000f042 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.250884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.251679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.251967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.252243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.263216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.264687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:37:48.282952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:48.284130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:48.285390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:37:48.285390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:37:48.285390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:37:48.285390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:48.289296 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 549/1099] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:48.290112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.346228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26577871-2235-46e7-8fb5-cda67000f042 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.356688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.381113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b83d37-a16e-4d06-a9df-b8d159d00bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.381800 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b83d37-a16e-4d06-a9df-b8d159d00bef None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.382091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b83d37-a16e-4d06-a9df-b8d159d00bef None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.382374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b83d37-a16e-4d06-a9df-b8d159d00bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.392520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2272-12d9-444d-8e6c-ebfd2eb1cd23 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.418742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.429045 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.429725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.430040 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.430846 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.431580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:48.431891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.433336 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.444957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 550/1100] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:48.451271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.453143 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b83d37-a16e-4d06-a9df-b8d159d00bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.454618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b83d37-a16e-4d06-a9df-b8d159d00bef None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.552743 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ed4ca-d7cb-46fc-9d43-5dcb7d64c7ce None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.556400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 551/1101] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:37:48.562177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b83d37-a16e-4d06-a9df-b8d159d00bef None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.581820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.591690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.592495 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.592781 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.593058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.599988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.601456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:37:48.615916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:37:48.616939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:37:48.618525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 551/1102] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:37:48.624140 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.643278 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.684692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b83d37-a16e-4d06-a9df-b8d159d00bef None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.727116 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198709-df69-4d69-998f-3be07eb25af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.728444 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198709-df69-4d69-998f-3be07eb25af7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.729043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198709-df69-4d69-998f-3be07eb25af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.729336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198709-df69-4d69-998f-3be07eb25af7 None admin] PATH_INFO: `/v3/projects/e75e4e20ff744572ab252da83adb8899` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.730986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f198709-df69-4d69-998f-3be07eb25af7 None admin] RBAC: Authorizing `identity:get_project(project_id=e75e4e20ff744572ab252da83adb8899)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.732930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f198709-df69-4d69-998f-3be07eb25af7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.735955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 552/1103] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/projects/e75e4e20ff744572ab252da83adb8899 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:48.742092 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198709-df69-4d69-998f-3be07eb25af7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.755217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35286685-0525-43b4-83f3-00ed42073e22 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.803295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.803979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.804266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.804548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.805932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:48.806250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.807734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.823457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 552/1104] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:48.830034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:48.872938 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198709-df69-4d69-998f-3be07eb25af7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:48.890108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.915600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e9867-2749-481c-ae56-b1b331f9c2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:48.916276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9867-2749-481c-ae56-b1b331f9c2d1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:48.916565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9867-2749-481c-ae56-b1b331f9c2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:48.916869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9867-2749-481c-ae56-b1b331f9c2d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:48.917714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e9867-2749-481c-ae56-b1b331f9c2d1 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=e75e4e20ff744572ab252da83adb8899, user.id=563eb02db8774ba382cc3fa3c275e80a) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:48.918100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e9867-2749-481c-ae56-b1b331f9c2d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:48.919634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e9867-2749-481c-ae56-b1b331f9c2d1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:48.923661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:48.939332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 553/1105] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/role_assignments?user.id=563eb02db8774ba382cc3fa3c275e80a&scope.project.id=e75e4e20ff744572ab252da83adb8899&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:48.961393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07fb5e-0a3a-4010-b8df-93df9b09a6d7 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:49.000077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25879514-906c-49d4-be76-ef50813dd206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:49.000676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879514-906c-49d4-be76-ef50813dd206 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:49.000967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879514-906c-49d4-be76-ef50813dd206 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:49.001251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879514-906c-49d4-be76-ef50813dd206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:49.002138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25879514-906c-49d4-be76-ef50813dd206 None admin] RBAC: Adding query filter params (role.id=567960a6d9004ce3a62daa2a63414d13, scope.project.id=c0b98559906540c082df06432223b497, user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:49.002458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25879514-906c-49d4-be76-ef50813dd206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:49.003962 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25879514-906c-49d4-be76-ef50813dd206 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:49.010969 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 553/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:48 2022] GET /identity/v3/role_assignments?user.id=7ac29fbb131c4ccf9ee7f26c4bd6523c&scope.project.id=c0b98559906540c082df06432223b497&role.id=567960a6d9004ce3a62daa2a63414d13 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:51.182643 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea9aa-d9c4-4a1b-bae5-acaf3408a622 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:51.183466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea9aa-d9c4-4a1b-bae5-acaf3408a622 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:51.183466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea9aa-d9c4-4a1b-bae5-acaf3408a622 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:51.184603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 554/1107] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:51.191231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6bef-5381-4e2e-9eba-9fbea8a0cb7a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:51.191734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6bef-5381-4e2e-9eba-9fbea8a0cb7a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:51.192206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6bef-5381-4e2e-9eba-9fbea8a0cb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:51.220447 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-209b6bef-5381-4e2e-9eba-9fbea8a0cb7a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:51.222452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-209b6bef-5381-4e2e-9eba-9fbea8a0cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:51.316728 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 554/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:37:51.342423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea9aa-d9c4-4a1b-bae5-acaf3408a622 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:51.450438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea9aa-d9c4-4a1b-bae5-acaf3408a622 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:51.488055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65b095-2864-4986-9feb-74d3e1ed6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:51.488859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65b095-2864-4986-9feb-74d3e1ed6f7b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:51.489143 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65b095-2864-4986-9feb-74d3e1ed6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:51.489417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65b095-2864-4986-9feb-74d3e1ed6f7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:51.490703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65b095-2864-4986-9feb-74d3e1ed6f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:51.492144 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65b095-2864-4986-9feb-74d3e1ed6f7b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:51.494773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 555/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:51.501312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6bef-5381-4e2e-9eba-9fbea8a0cb7a None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:51.543365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:51.605234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6bef-5381-4e2e-9eba-9fbea8a0cb7a None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:51.642437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23fcb5-641a-429a-9a1d-8fb391f37cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:51.643122 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23fcb5-641a-429a-9a1d-8fb391f37cd0 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:51.643408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23fcb5-641a-429a-9a1d-8fb391f37cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:51.643683 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23fcb5-641a-429a-9a1d-8fb391f37cd0 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:51.644411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23fcb5-641a-429a-9a1d-8fb391f37cd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:51.645896 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23fcb5-641a-429a-9a1d-8fb391f37cd0 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:51.669089 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 555/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:37:51 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:37:53.998604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ca990-ec58-4f8d-a599-1e6114c73b1c None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:53.999170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ca990-ec58-4f8d-a599-1e6114c73b1c None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:53.999170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ca990-ec58-4f8d-a599-1e6114c73b1c None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:54.000680 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 556/1111] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:37:54.006797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f58993-02b2-489f-bfb8-062fe8ad3c7c None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:54.007353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f58993-02b2-489f-bfb8-062fe8ad3c7c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:54.007353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f58993-02b2-489f-bfb8-062fe8ad3c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:54.026431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-e2f58993-02b2-489f-bfb8-062fe8ad3c7c None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:54.027674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e2f58993-02b2-489f-bfb8-062fe8ad3c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:54.098832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 556/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:54.123736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ca990-ec58-4f8d-a599-1e6114c73b1c None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:54.198595 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:54.236942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ca990-ec58-4f8d-a599-1e6114c73b1c None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:54.274481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06a270-87c0-4098-b79b-5d21c90f21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:54.275343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a270-87c0-4098-b79b-5d21c90f21b5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:54.275630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a270-87c0-4098-b79b-5d21c90f21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:54.275908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a270-87c0-4098-b79b-5d21c90f21b5 None admin] PATH_INFO: `/v3/roles/7252c7aaa32c4c28b47eedca12cee086` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:54.277413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06a270-87c0-4098-b79b-5d21c90f21b5 None admin] RBAC: Authorizing `identity:get_role(role_id=7252c7aaa32c4c28b47eedca12cee086)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:54.278830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06a270-87c0-4098-b79b-5d21c90f21b5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:54.280251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 557/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:37:54 2022] GET /identity/v3/roles/7252c7aaa32c4c28b47eedca12cee086 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:54.286278 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f58993-02b2-489f-bfb8-062fe8ad3c7c None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:54.315288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:54.393362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f58993-02b2-489f-bfb8-062fe8ad3c7c None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:54.430562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1276b36-3b33-4f67-abfa-18dc56a22559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:54.431511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1276b36-3b33-4f67-abfa-18dc56a22559 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:54.431855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1276b36-3b33-4f67-abfa-18dc56a22559 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:54.432180 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1276b36-3b33-4f67-abfa-18dc56a22559 None admin] PATH_INFO: `/v3/users/e71f1d16569d47c6bdabc39cb12e8d02` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:54.447322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1276b36-3b33-4f67-abfa-18dc56a22559 None admin] RBAC: Authorizing `identity:get_user(user_id=e71f1d16569d47c6bdabc39cb12e8d02)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:54.448885 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1276b36-3b33-4f67-abfa-18dc56a22559 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:54.450770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 557/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:37:54 2022] GET /identity/v3/users/e71f1d16569d47c6bdabc39cb12e8d02 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:54.456797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06a270-87c0-4098-b79b-5d21c90f21b5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:54.606745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06a270-87c0-4098-b79b-5d21c90f21b5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:54.660102 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a583b-3a1e-4f3a-9e54-1843538ca41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:54.661056 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a583b-3a1e-4f3a-9e54-1843538ca41d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:54.661526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a583b-3a1e-4f3a-9e54-1843538ca41d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:54.662026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a583b-3a1e-4f3a-9e54-1843538ca41d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:54.668405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:54.743227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a583b-3a1e-4f3a-9e54-1843538ca41d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:54.744781 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a583b-3a1e-4f3a-9e54-1843538ca41d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:54.855976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 558/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:37:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:37:54.862646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1276b36-3b33-4f67-abfa-18dc56a22559 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:54.953213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:54.971029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1276b36-3b33-4f67-abfa-18dc56a22559 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:55.008923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe2515-6c6b-4034-bcf0-d3b946480034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:55.009827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe2515-6c6b-4034-bcf0-d3b946480034 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:55.010117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe2515-6c6b-4034-bcf0-d3b946480034 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:55.010398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe2515-6c6b-4034-bcf0-d3b946480034 None admin] PATH_INFO: `/v3/projects/e75e4e20ff744572ab252da83adb8899` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:55.011619 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe2515-6c6b-4034-bcf0-d3b946480034 None admin] RBAC: Authorizing `identity:get_project(project_id=e75e4e20ff744572ab252da83adb8899)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:55.013078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe2515-6c6b-4034-bcf0-d3b946480034 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:55.014880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 558/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:37:54 2022] GET /identity/v3/projects/e75e4e20ff744572ab252da83adb8899 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:55.021272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a583b-3a1e-4f3a-9e54-1843538ca41d None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:55.060730 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:55.132611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a583b-3a1e-4f3a-9e54-1843538ca41d None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:55.169189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd116f6f-a6f5-4f52-9975-be6433a4c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:55.169888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd116f6f-a6f5-4f52-9975-be6433a4c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:55.170177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd116f6f-a6f5-4f52-9975-be6433a4c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:55.170453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd116f6f-a6f5-4f52-9975-be6433a4c2e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:55.171295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd116f6f-a6f5-4f52-9975-be6433a4c2e6 None admin] RBAC: Adding query filter params (role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=e75e4e20ff744572ab252da83adb8899, user.id=e71f1d16569d47c6bdabc39cb12e8d02) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:37:55.171609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd116f6f-a6f5-4f52-9975-be6433a4c2e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:55.173071 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd116f6f-a6f5-4f52-9975-be6433a4c2e6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:55.179338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 559/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:37:55 2022] GET /identity/v3/role_assignments?user.id=e71f1d16569d47c6bdabc39cb12e8d02&scope.project.id=e75e4e20ff744572ab252da83adb8899&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:57.433469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ad32-5634-467b-9a30-d9be9abe612c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:57.434074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ad32-5634-467b-9a30-d9be9abe612c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:57.434074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ad32-5634-467b-9a30-d9be9abe612c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:57.435465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 559/1118] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:37:57.441302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0be8-8812-4523-83f3-220e5c6f12c6 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:57.441857 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0be8-8812-4523-83f3-220e5c6f12c6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:57.441984 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0be8-8812-4523-83f3-220e5c6f12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:57.459961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-87af0be8-8812-4523-83f3-220e5c6f12c6 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:37:57.461977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-87af0be8-8812-4523-83f3-220e5c6f12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:37:57.534999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 560/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:37:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:37:57.558948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ad32-5634-467b-9a30-d9be9abe612c None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:57.674995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ad32-5634-467b-9a30-d9be9abe612c None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:57.723821 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38df3-7def-44c9-ae29-daaafee2326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:57.725095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38df3-7def-44c9-ae29-daaafee2326e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:57.725532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38df3-7def-44c9-ae29-daaafee2326e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:57.726020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38df3-7def-44c9-ae29-daaafee2326e None admin] PATH_INFO: `/v3/roles/7252c7aaa32c4c28b47eedca12cee086` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:57.729130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e38df3-7def-44c9-ae29-daaafee2326e None admin] RBAC: Authorizing `identity:get_role(role_id=7252c7aaa32c4c28b47eedca12cee086)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:57.731719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e38df3-7def-44c9-ae29-daaafee2326e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:57.734333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 560/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:37:57 2022] GET /identity/v3/roles/7252c7aaa32c4c28b47eedca12cee086 => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:57.740490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af0be8-8812-4523-83f3-220e5c6f12c6 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:57.773547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:57.857614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af0be8-8812-4523-83f3-220e5c6f12c6 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:57.896048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53bcbd-9aa4-4098-a969-11b8cc11f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:57.897039 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53bcbd-9aa4-4098-a969-11b8cc11f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:57.897257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53bcbd-9aa4-4098-a969-11b8cc11f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:57.897547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53bcbd-9aa4-4098-a969-11b8cc11f6d0 None admin] PATH_INFO: `/v3/users/e71f1d16569d47c6bdabc39cb12e8d02` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:57.899462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53bcbd-9aa4-4098-a969-11b8cc11f6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=e71f1d16569d47c6bdabc39cb12e8d02)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:57.900926 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53bcbd-9aa4-4098-a969-11b8cc11f6d0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:57.902688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 561/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:37:57 2022] GET /identity/v3/users/e71f1d16569d47c6bdabc39cb12e8d02 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:37:57.911734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38df3-7def-44c9-ae29-daaafee2326e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:57.950076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:58.083157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38df3-7def-44c9-ae29-daaafee2326e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:58.140055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd584122-2821-4d45-a330-e152e07d13fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:58.141498 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd584122-2821-4d45-a330-e152e07d13fa None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:58.142024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd584122-2821-4d45-a330-e152e07d13fa None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:58.142493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd584122-2821-4d45-a330-e152e07d13fa None admin] PATH_INFO: `/v3/projects/e75e4e20ff744572ab252da83adb8899` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:58.144538 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd584122-2821-4d45-a330-e152e07d13fa None admin] RBAC: Authorizing `identity:get_project(project_id=e75e4e20ff744572ab252da83adb8899)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:58.147161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd584122-2821-4d45-a330-e152e07d13fa None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:58.150878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 561/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:37:57 2022] GET /identity/v3/projects/e75e4e20ff744572ab252da83adb8899 => generated 311 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:37:58.157004 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53bcbd-9aa4-4098-a969-11b8cc11f6d0 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:37:58.261687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:37:58.266369 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53bcbd-9aa4-4098-a969-11b8cc11f6d0 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:37:58.303588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0be67-9bdc-4006-a063-0cc72b38a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:37:58.304490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0be67-9bdc-4006-a063-0cc72b38a632 None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:37:58.304774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0be67-9bdc-4006-a063-0cc72b38a632 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:37:58.305596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0be67-9bdc-4006-a063-0cc72b38a632 None admin] PATH_INFO: `/v3/projects/e75e4e20ff744572ab252da83adb8899/users/e71f1d16569d47c6bdabc39cb12e8d02/roles/7252c7aaa32c4c28b47eedca12cee086` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:37:58.307982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0be67-9bdc-4006-a063-0cc72b38a632 None admin] RBAC: Authorizing `identity:create_grant(project_id=e75e4e20ff744572ab252da83adb8899, user_id=e71f1d16569d47c6bdabc39cb12e8d02, role_id=7252c7aaa32c4c28b47eedca12cee086)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:37:58.309466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0be67-9bdc-4006-a063-0cc72b38a632 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:37:58.327903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 562/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:37:58 2022] PUT /identity/v3/projects/e75e4e20ff744572ab252da83adb8899/users/e71f1d16569d47c6bdabc39cb12e8d02/roles/7252c7aaa32c4c28b47eedca12cee086 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:38:00.611236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebabd35-9c90-4c17-a962-05900ee1409e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:00.611785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebabd35-9c90-4c17-a962-05900ee1409e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:00.611785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebabd35-9c90-4c17-a962-05900ee1409e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:00.613161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 562/1124] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:00.620207 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f9f6-ae00-4be4-94db-f274977f05ab None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:00.620712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f9f6-ae00-4be4-94db-f274977f05ab None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:00.621195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f9f6-ae00-4be4-94db-f274977f05ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:00.647353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-f7d9f9f6-ae00-4be4-94db-f274977f05ab None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:00.649290 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f7d9f9f6-ae00-4be4-94db-f274977f05ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:00.755379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 563/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:00.779510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebabd35-9c90-4c17-a962-05900ee1409e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:00.872106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:00.885690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebabd35-9c90-4c17-a962-05900ee1409e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:00.920453 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ec33-8ac4-46f3-af91-16203b43fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:00.921389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ec33-8ac4-46f3-af91-16203b43fe64 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:00.921810 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ec33-8ac4-46f3-af91-16203b43fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:00.922139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ec33-8ac4-46f3-af91-16203b43fe64 None admin] PATH_INFO: `/v3/roles/7252c7aaa32c4c28b47eedca12cee086` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:00.923690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922ec33-8ac4-46f3-af91-16203b43fe64 None admin] RBAC: Authorizing `identity:get_role(role_id=7252c7aaa32c4c28b47eedca12cee086)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:00.925134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922ec33-8ac4-46f3-af91-16203b43fe64 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:00.926621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 563/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:38:00 2022] GET /identity/v3/roles/7252c7aaa32c4c28b47eedca12cee086 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:00.932629 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9f9f6-ae00-4be4-94db-f274977f05ab None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:01.024010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:01.038529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9f9f6-ae00-4be4-94db-f274977f05ab None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:01.076707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220e32b-6630-46b8-9138-fe45146852b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:01.077654 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220e32b-6630-46b8-9138-fe45146852b6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:01.077967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220e32b-6630-46b8-9138-fe45146852b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:01.078244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220e32b-6630-46b8-9138-fe45146852b6 None admin] PATH_INFO: `/v3/users/e71f1d16569d47c6bdabc39cb12e8d02` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:01.079640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220e32b-6630-46b8-9138-fe45146852b6 None admin] RBAC: Authorizing `identity:get_user(user_id=e71f1d16569d47c6bdabc39cb12e8d02)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:01.081130 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220e32b-6630-46b8-9138-fe45146852b6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:01.083022 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 564/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:38:00 2022] GET /identity/v3/users/e71f1d16569d47c6bdabc39cb12e8d02 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:01.092975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ec33-8ac4-46f3-af91-16203b43fe64 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:01.215913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ec33-8ac4-46f3-af91-16203b43fe64 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:01.277752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76426f6-1cac-4b3e-849b-58aa68b58d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:01.278905 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76426f6-1cac-4b3e-849b-58aa68b58d13 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:01.279425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76426f6-1cac-4b3e-849b-58aa68b58d13 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:01.279935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76426f6-1cac-4b3e-849b-58aa68b58d13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:01.325915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:01.395745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76426f6-1cac-4b3e-849b-58aa68b58d13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:01.397255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76426f6-1cac-4b3e-849b-58aa68b58d13 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:01.498641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 564/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:38:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:38:01.508036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220e32b-6630-46b8-9138-fe45146852b6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:01.612486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220e32b-6630-46b8-9138-fe45146852b6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:01.648608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a62526-84f8-46b7-8323-b72906c9ca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:01.650151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62526-84f8-46b7-8323-b72906c9ca24 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:01.650489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62526-84f8-46b7-8323-b72906c9ca24 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:01.650819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62526-84f8-46b7-8323-b72906c9ca24 None admin] PATH_INFO: `/v3/projects/e75e4e20ff744572ab252da83adb8899` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:01.652155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a62526-84f8-46b7-8323-b72906c9ca24 None admin] RBAC: Authorizing `identity:get_project(project_id=e75e4e20ff744572ab252da83adb8899)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:01.653678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a62526-84f8-46b7-8323-b72906c9ca24 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:01.655495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 565/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:38:01 2022] GET /identity/v3/projects/e75e4e20ff744572ab252da83adb8899 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:01.666526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76426f6-1cac-4b3e-849b-58aa68b58d13 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:01.736997 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:01.783483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76426f6-1cac-4b3e-849b-58aa68b58d13 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:01.825929 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e5fb4-dc59-424b-ae78-9191675bd3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:01.827094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5fb4-dc59-424b-ae78-9191675bd3fd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:01.827599 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5fb4-dc59-424b-ae78-9191675bd3fd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:01.828115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5fb4-dc59-424b-ae78-9191675bd3fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:01.829835 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e5fb4-dc59-424b-ae78-9191675bd3fd None admin] RBAC: Adding query filter params (role.id=7252c7aaa32c4c28b47eedca12cee086, scope.project.id=e75e4e20ff744572ab252da83adb8899, user.id=e71f1d16569d47c6bdabc39cb12e8d02) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:01.830422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e5fb4-dc59-424b-ae78-9191675bd3fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:01.833298 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e5fb4-dc59-424b-ae78-9191675bd3fd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:01.845679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 565/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:38:01 2022] GET /identity/v3/role_assignments?user.id=e71f1d16569d47c6bdabc39cb12e8d02&scope.project.id=e75e4e20ff744572ab252da83adb8899&role.id=7252c7aaa32c4c28b47eedca12cee086 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:38:04.120101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442bfc9-8a25-4a8a-a103-ff1c54cd71d3 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:04.120617 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442bfc9-8a25-4a8a-a103-ff1c54cd71d3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:04.120617 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442bfc9-8a25-4a8a-a103-ff1c54cd71d3 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:04.122216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 566/1131] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:04.127398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d866c-2cce-4c5b-91fa-f87f7c6a5451 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:04.127820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d866c-2cce-4c5b-91fa-f87f7c6a5451 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:04.127964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d866c-2cce-4c5b-91fa-f87f7c6a5451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:04.144445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-961d866c-2cce-4c5b-91fa-f87f7c6a5451 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:04.145631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-961d866c-2cce-4c5b-91fa-f87f7c6a5451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:04.210450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 566/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:04.235018 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442bfc9-8a25-4a8a-a103-ff1c54cd71d3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:04.259442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:04.336924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442bfc9-8a25-4a8a-a103-ff1c54cd71d3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:04.369634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faa335-aa3c-4299-a142-cedfbb647356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:04.370496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa335-aa3c-4299-a142-cedfbb647356 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:04.370723 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa335-aa3c-4299-a142-cedfbb647356 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:04.370999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa335-aa3c-4299-a142-cedfbb647356 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:04.372158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faa335-aa3c-4299-a142-cedfbb647356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:04.373596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faa335-aa3c-4299-a142-cedfbb647356 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:04.375253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 567/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:38:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:04.381230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d866c-2cce-4c5b-91fa-f87f7c6a5451 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:04.429852 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:04.479271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d866c-2cce-4c5b-91fa-f87f7c6a5451 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:04.513461 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef0968-9abf-4669-9d3d-df4fde84e843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:04.514158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0968-9abf-4669-9d3d-df4fde84e843 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:04.514450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0968-9abf-4669-9d3d-df4fde84e843 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:04.514737 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0968-9abf-4669-9d3d-df4fde84e843 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:04.515439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef0968-9abf-4669-9d3d-df4fde84e843 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:04.516893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef0968-9abf-4669-9d3d-df4fde84e843 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:04.543454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 567/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:38:04 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:38:06.820027 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a96a-0d08-408b-a1b9-63122b2ba839 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:06.820540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a96a-0d08-408b-a1b9-63122b2ba839 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:06.820646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a96a-0d08-408b-a1b9-63122b2ba839 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:06.822060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 568/1135] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:06.827547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4edc22-8da0-48ba-b93b-deceb005e67f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:06.827985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4edc22-8da0-48ba-b93b-deceb005e67f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:06.828096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4edc22-8da0-48ba-b93b-deceb005e67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:06.845774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-db4edc22-8da0-48ba-b93b-deceb005e67f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:06.846968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-db4edc22-8da0-48ba-b93b-deceb005e67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:06.915898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 568/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:06.941520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5a96a-0d08-408b-a1b9-63122b2ba839 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:07.043522 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:07.054600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5a96a-0d08-408b-a1b9-63122b2ba839 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:07.089858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff703d9a-08b1-41ce-8fd9-5da279675384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:07.090667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff703d9a-08b1-41ce-8fd9-5da279675384 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:07.090982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff703d9a-08b1-41ce-8fd9-5da279675384 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:07.091287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff703d9a-08b1-41ce-8fd9-5da279675384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:07.092496 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff703d9a-08b1-41ce-8fd9-5da279675384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:07.093988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff703d9a-08b1-41ce-8fd9-5da279675384 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:07.095662 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 569/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:07.102221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4edc22-8da0-48ba-b93b-deceb005e67f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:07.132633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:07.202074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4edc22-8da0-48ba-b93b-deceb005e67f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:07.236511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd75df-7799-42fe-becb-69190e1d46cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:07.237185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd75df-7799-42fe-becb-69190e1d46cb None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:07.237476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd75df-7799-42fe-becb-69190e1d46cb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:07.237777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd75df-7799-42fe-becb-69190e1d46cb None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:07.238505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd75df-7799-42fe-becb-69190e1d46cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:07.239962 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd75df-7799-42fe-becb-69190e1d46cb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:07.260119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 569/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:38:07 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:38:09.535625 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141236-b67e-4a90-b77d-872ab5006ec5 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:09.536165 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141236-b67e-4a90-b77d-872ab5006ec5 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:09.536165 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141236-b67e-4a90-b77d-872ab5006ec5 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:09.537578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 570/1139] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:09.543245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7e39a-7a01-4c31-828e-63aff6766e3f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:09.543726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7e39a-7a01-4c31-828e-63aff6766e3f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:09.543911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7e39a-7a01-4c31-828e-63aff6766e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:09.561144 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-ede7e39a-7a01-4c31-828e-63aff6766e3f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:09.562388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ede7e39a-7a01-4c31-828e-63aff6766e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:09.629081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 570/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:09.653546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141236-b67e-4a90-b77d-872ab5006ec5 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:09.763576 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141236-b67e-4a90-b77d-872ab5006ec5 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:09.798848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1520f-d7b7-4874-a218-22911be72b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:09.799651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1520f-d7b7-4874-a218-22911be72b31 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:09.799942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1520f-d7b7-4874-a218-22911be72b31 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:09.800224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1520f-d7b7-4874-a218-22911be72b31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:09.811225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1520f-d7b7-4874-a218-22911be72b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-d4d1520f-d7b7-4874-a218-22911be72b31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:38:09.818937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:38:09.820082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:38:09.826401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 571/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:38:09.827305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7e39a-7a01-4c31-828e-63aff6766e3f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:09.845166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:09.927251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7e39a-7a01-4c31-828e-63aff6766e3f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:09.961145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:09.961849 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:09.962138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:09.962413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:09.963148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:09.963454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:09.964824 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:09.972955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 571/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:09.979523 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1520f-d7b7-4874-a218-22911be72b31 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:10.002627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:10.080753 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1520f-d7b7-4874-a218-22911be72b31 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:10.114056 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3e13-a188-4f9c-9535-ae8cf01750b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:10.114932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3e13-a188-4f9c-9535-ae8cf01750b9 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:10.115220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3e13-a188-4f9c-9535-ae8cf01750b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:10.115501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3e13-a188-4f9c-9535-ae8cf01750b9 None admin] PATH_INFO: `/v3/users/ef4f10a2f9b64651a7f9dafc619ae41e` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:10.129329 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3e13-a188-4f9c-9535-ae8cf01750b9 None admin] RBAC: Authorizing `identity:get_user(user_id=ef4f10a2f9b64651a7f9dafc619ae41e)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:10.130812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3e13-a188-4f9c-9535-ae8cf01750b9 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:10.132548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 572/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:38:09 2022] GET /identity/v3/users/ef4f10a2f9b64651a7f9dafc619ae41e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:10.138510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:10.218990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:10.238935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278516b4-ceab-45c3-9cb9-e2a968b9f430 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:10.271689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ade5f-e23d-43ea-aec5-ad1315faadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:10.272343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ade5f-e23d-43ea-aec5-ad1315faadc2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:10.272629 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ade5f-e23d-43ea-aec5-ad1315faadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:10.272912 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ade5f-e23d-43ea-aec5-ad1315faadc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:10.341198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ade5f-e23d-43ea-aec5-ad1315faadc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:10.342663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ade5f-e23d-43ea-aec5-ad1315faadc2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:10.426383 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:10.446992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 572/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:38:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:38:10.453050 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3e13-a188-4f9c-9535-ae8cf01750b9 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:10.531900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:10.554045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3e13-a188-4f9c-9535-ae8cf01750b9 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:10.588138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cc1ce-70c2-49c2-808c-b99e9068b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:10.588998 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc1ce-70c2-49c2-808c-b99e9068b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:10.589281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc1ce-70c2-49c2-808c-b99e9068b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:10.589559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc1ce-70c2-49c2-808c-b99e9068b1b1 None admin] PATH_INFO: `/v3/projects/40372b45d8924aecaa75f61f3bb37e37` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:10.590778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cc1ce-70c2-49c2-808c-b99e9068b1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=40372b45d8924aecaa75f61f3bb37e37)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:10.592272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cc1ce-70c2-49c2-808c-b99e9068b1b1 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:10.593997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 573/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:38:10 2022] GET /identity/v3/projects/40372b45d8924aecaa75f61f3bb37e37 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:10.600070 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ade5f-e23d-43ea-aec5-ad1315faadc2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:10.698028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ade5f-e23d-43ea-aec5-ad1315faadc2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:10.732626 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4d14c-9032-455f-b9a6-0faa0fd30a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:10.733291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d14c-9032-455f-b9a6-0faa0fd30a9e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:10.733576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d14c-9032-455f-b9a6-0faa0fd30a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:10.733885 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d14c-9032-455f-b9a6-0faa0fd30a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:10.734716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4d14c-9032-455f-b9a6-0faa0fd30a9e None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=40372b45d8924aecaa75f61f3bb37e37, user.id=ef4f10a2f9b64651a7f9dafc619ae41e) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:10.735027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4d14c-9032-455f-b9a6-0faa0fd30a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:10.736481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4d14c-9032-455f-b9a6-0faa0fd30a9e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:10.742355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 573/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:38:10 2022] GET /identity/v3/role_assignments?user.id=ef4f10a2f9b64651a7f9dafc619ae41e&scope.project.id=40372b45d8924aecaa75f61f3bb37e37&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:12.965441 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55328f-23a7-42a0-89b6-e4063f4da6d7 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:12.965986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55328f-23a7-42a0-89b6-e4063f4da6d7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:12.966109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55328f-23a7-42a0-89b6-e4063f4da6d7 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:12.967408 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 574/1147] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:12.972749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1e75-70f0-48aa-85f0-01bb25422b00 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:12.973156 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1e75-70f0-48aa-85f0-01bb25422b00 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:12.973305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1e75-70f0-48aa-85f0-01bb25422b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:12.990181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-69fa1e75-70f0-48aa-85f0-01bb25422b00 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:12.991394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-69fa1e75-70f0-48aa-85f0-01bb25422b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:13.030156 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:13.057290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 574/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:13.088256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55328f-23a7-42a0-89b6-e4063f4da6d7 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:13.191707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55328f-23a7-42a0-89b6-e4063f4da6d7 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:13.228683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aab293-3eef-4ded-b592-a4472d175b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:13.229474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aab293-3eef-4ded-b592-a4472d175b89 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:13.229785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aab293-3eef-4ded-b592-a4472d175b89 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:13.230068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aab293-3eef-4ded-b592-a4472d175b89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:13.240178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aab293-3eef-4ded-b592-a4472d175b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-96aab293-3eef-4ded-b592-a4472d175b89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:38:13.247767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:38:13.248897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:38:13.250014 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 575/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:38:13.255064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1e75-70f0-48aa-85f0-01bb25422b00 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:13.350404 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1e75-70f0-48aa-85f0-01bb25422b00 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:13.383482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:13.384165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:13.384450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:13.384725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:13.385464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:13.385794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:13.387181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:13.395562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 575/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:13.402282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aab293-3eef-4ded-b592-a4472d175b89 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:13.411590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:13.501443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aab293-3eef-4ded-b592-a4472d175b89 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:13.533890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c43dc-a55a-4ed2-954a-dff989b1bb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:13.534752 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c43dc-a55a-4ed2-954a-dff989b1bb3b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:13.535037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c43dc-a55a-4ed2-954a-dff989b1bb3b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:13.535313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c43dc-a55a-4ed2-954a-dff989b1bb3b None admin] PATH_INFO: `/v3/users/ef4f10a2f9b64651a7f9dafc619ae41e` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:13.536491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c43dc-a55a-4ed2-954a-dff989b1bb3b None admin] RBAC: Authorizing `identity:get_user(user_id=ef4f10a2f9b64651a7f9dafc619ae41e)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:13.537975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c43dc-a55a-4ed2-954a-dff989b1bb3b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:13.540203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 576/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:38:13 2022] GET /identity/v3/users/ef4f10a2f9b64651a7f9dafc619ae41e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:13.546023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:13.580237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:13.643780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced20d9-2093-4080-acbc-85f569860679 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:13.676400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e98dc-762e-44d5-a3ee-00f9325f93a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:13.677257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e98dc-762e-44d5-a3ee-00f9325f93a2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:13.677546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e98dc-762e-44d5-a3ee-00f9325f93a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:13.677855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e98dc-762e-44d5-a3ee-00f9325f93a2 None admin] PATH_INFO: `/v3/projects/40372b45d8924aecaa75f61f3bb37e37` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:13.679028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e98dc-762e-44d5-a3ee-00f9325f93a2 None admin] RBAC: Authorizing `identity:get_project(project_id=40372b45d8924aecaa75f61f3bb37e37)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:13.680503 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e98dc-762e-44d5-a3ee-00f9325f93a2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:13.682234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 576/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:38:13 2022] GET /identity/v3/projects/40372b45d8924aecaa75f61f3bb37e37 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:13.688126 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c43dc-a55a-4ed2-954a-dff989b1bb3b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:13.786409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:13.811631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c43dc-a55a-4ed2-954a-dff989b1bb3b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:13.844478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56511666-c5c5-4f2b-9332-72e3bc0718dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:13.845347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511666-c5c5-4f2b-9332-72e3bc0718dc None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:13.845628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511666-c5c5-4f2b-9332-72e3bc0718dc None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:13.845933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511666-c5c5-4f2b-9332-72e3bc0718dc None admin] PATH_INFO: `/v3/projects/40372b45d8924aecaa75f61f3bb37e37/users/ef4f10a2f9b64651a7f9dafc619ae41e/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:13.847859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56511666-c5c5-4f2b-9332-72e3bc0718dc None admin] RBAC: Authorizing `identity:create_grant(project_id=40372b45d8924aecaa75f61f3bb37e37, user_id=ef4f10a2f9b64651a7f9dafc619ae41e, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:13.849288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56511666-c5c5-4f2b-9332-72e3bc0718dc None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:13.862836 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 577/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:38:13 2022] PUT /identity/v3/projects/40372b45d8924aecaa75f61f3bb37e37/users/ef4f10a2f9b64651a7f9dafc619ae41e/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:38:16.032124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163f94-f14b-4ff8-8bd8-0cd2e6ecce9d None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:16.032699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163f94-f14b-4ff8-8bd8-0cd2e6ecce9d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:16.032699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163f94-f14b-4ff8-8bd8-0cd2e6ecce9d None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:16.034131 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 577/1154] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:16.039957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c84c-1a24-4791-9ca1-99118c3235b1 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:16.040404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c84c-1a24-4791-9ca1-99118c3235b1 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:16.040506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743c84c-1a24-4791-9ca1-99118c3235b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:16.057497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b743c84c-1a24-4791-9ca1-99118c3235b1 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:16.058658 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b743c84c-1a24-4791-9ca1-99118c3235b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:16.121764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 578/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:38:16.144727 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d163f94-f14b-4ff8-8bd8-0cd2e6ecce9d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:16.243136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d163f94-f14b-4ff8-8bd8-0cd2e6ecce9d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:16.245452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:16.276711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90058f30-070d-4aa8-8114-6c5fa04359d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:16.277496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90058f30-070d-4aa8-8114-6c5fa04359d1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:16.277805 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90058f30-070d-4aa8-8114-6c5fa04359d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:16.278089 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90058f30-070d-4aa8-8114-6c5fa04359d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:16.287913 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90058f30-070d-4aa8-8114-6c5fa04359d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-90058f30-070d-4aa8-8114-6c5fa04359d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:38:16.295981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:38:16.297220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:38:16.298414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 578/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:38:16.303269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743c84c-1a24-4791-9ca1-99118c3235b1 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:16.362421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:16.399452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743c84c-1a24-4791-9ca1-99118c3235b1 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:16.432603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:16.433255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:16.433565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:16.433870 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:16.434610 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:16.434918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:16.436277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:16.444123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 579/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:16.450048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90058f30-070d-4aa8-8114-6c5fa04359d1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:16.549644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90058f30-070d-4aa8-8114-6c5fa04359d1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:16.582128 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d7da4-0dd8-4a0d-9f41-8d7c1f8390d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:16.583000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d7da4-0dd8-4a0d-9f41-8d7c1f8390d9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:16.583288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d7da4-0dd8-4a0d-9f41-8d7c1f8390d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:16.583569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d7da4-0dd8-4a0d-9f41-8d7c1f8390d9 None admin] PATH_INFO: `/v3/users/ef4f10a2f9b64651a7f9dafc619ae41e` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:16.584766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d7da4-0dd8-4a0d-9f41-8d7c1f8390d9 None admin] RBAC: Authorizing `identity:get_user(user_id=ef4f10a2f9b64651a7f9dafc619ae41e)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:16.586856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d7da4-0dd8-4a0d-9f41-8d7c1f8390d9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:16.588580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 579/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:38:16 2022] GET /identity/v3/users/ef4f10a2f9b64651a7f9dafc619ae41e => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:16.594439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:16.693058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1111f-5acf-491e-88f9-108ea2ebb054 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:16.719322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:16.728375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c066c7-d3e4-45d2-9476-2dfb87c5c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:16.729036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c066c7-d3e4-45d2-9476-2dfb87c5c193 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:16.729306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c066c7-d3e4-45d2-9476-2dfb87c5c193 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:16.729584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c066c7-d3e4-45d2-9476-2dfb87c5c193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:16.802394 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c066c7-d3e4-45d2-9476-2dfb87c5c193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:16.803883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c066c7-d3e4-45d2-9476-2dfb87c5c193 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:16.907807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 580/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:38:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:38:16.913922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d7da4-0dd8-4a0d-9f41-8d7c1f8390d9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:16.945061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:17.011853 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d7da4-0dd8-4a0d-9f41-8d7c1f8390d9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:17.043864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a897e-1db8-40b2-abfc-72ffa7b22498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:17.044724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a897e-1db8-40b2-abfc-72ffa7b22498 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:17.045011 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a897e-1db8-40b2-abfc-72ffa7b22498 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:17.045290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a897e-1db8-40b2-abfc-72ffa7b22498 None admin] PATH_INFO: `/v3/projects/40372b45d8924aecaa75f61f3bb37e37` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:17.046479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a897e-1db8-40b2-abfc-72ffa7b22498 None admin] RBAC: Authorizing `identity:get_project(project_id=40372b45d8924aecaa75f61f3bb37e37)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:17.047925 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a897e-1db8-40b2-abfc-72ffa7b22498 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:17.049630 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 580/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:38:16 2022] GET /identity/v3/projects/40372b45d8924aecaa75f61f3bb37e37 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:17.056219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c066c7-d3e4-45d2-9476-2dfb87c5c193 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:17.091640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:17.162381 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c066c7-d3e4-45d2-9476-2dfb87c5c193 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:17.197241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7778c21-621b-429b-aee2-697b22a2de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:17.197838 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778c21-621b-429b-aee2-697b22a2de9c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:17.198133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778c21-621b-429b-aee2-697b22a2de9c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:17.198416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778c21-621b-429b-aee2-697b22a2de9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:17.199256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7778c21-621b-429b-aee2-697b22a2de9c None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=40372b45d8924aecaa75f61f3bb37e37, user.id=ef4f10a2f9b64651a7f9dafc619ae41e) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:17.199574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7778c21-621b-429b-aee2-697b22a2de9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:17.201030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7778c21-621b-429b-aee2-697b22a2de9c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:17.207026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 581/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:38:17 2022] GET /identity/v3/role_assignments?user.id=ef4f10a2f9b64651a7f9dafc619ae41e&scope.project.id=40372b45d8924aecaa75f61f3bb37e37&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:19.420661 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396685-665b-4b61-9ba6-6dfac0a4ba7c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:19.421223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396685-665b-4b61-9ba6-6dfac0a4ba7c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:19.421223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396685-665b-4b61-9ba6-6dfac0a4ba7c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:19.422665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 581/1162] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:19.428067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a241-7dc0-40f7-b064-56f0c4bc61cb None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:19.428478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a241-7dc0-40f7-b064-56f0c4bc61cb None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:19.428631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a241-7dc0-40f7-b064-56f0c4bc61cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:19.446335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-2081a241-7dc0-40f7-b064-56f0c4bc61cb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:19.447559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-2081a241-7dc0-40f7-b064-56f0c4bc61cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:19.517499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 582/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:19.540571 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d396685-665b-4b61-9ba6-6dfac0a4ba7c None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:19.639336 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:19.644573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d396685-665b-4b61-9ba6-6dfac0a4ba7c None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:19.678581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff994e15-4455-4a13-84c1-484d09701fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:19.679161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994e15-4455-4a13-84c1-484d09701fa9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:19.679987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994e15-4455-4a13-84c1-484d09701fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:19.680275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994e15-4455-4a13-84c1-484d09701fa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:19.746742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff994e15-4455-4a13-84c1-484d09701fa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:19.748208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff994e15-4455-4a13-84c1-484d09701fa9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:19.842361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:19.846791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 582/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:38:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:38:19.853204 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081a241-7dc0-40f7-b064-56f0c4bc61cb None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:19.874759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:19.954746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081a241-7dc0-40f7-b064-56f0c4bc61cb None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:19.989961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79229b54-48f6-4ae0-9515-6de646eb957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:19.990883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79229b54-48f6-4ae0-9515-6de646eb957d None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:19.991177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79229b54-48f6-4ae0-9515-6de646eb957d None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:19.991462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79229b54-48f6-4ae0-9515-6de646eb957d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:19.998330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79229b54-48f6-4ae0-9515-6de646eb957d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:19.999779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79229b54-48f6-4ae0-9515-6de646eb957d None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-79229b54-48f6-4ae0-9515-6de646eb957d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:38:20.013702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:38:20.015057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:38:20.016254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 583/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:38:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:38:20.021039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff994e15-4455-4a13-84c1-484d09701fa9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:20.119804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff994e15-4455-4a13-84c1-484d09701fa9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:20.153373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf497-4fc6-479c-a8e6-6a14b5e74e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:20.154079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf497-4fc6-479c-a8e6-6a14b5e74e6d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:20.154362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf497-4fc6-479c-a8e6-6a14b5e74e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:20.154638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf497-4fc6-479c-a8e6-6a14b5e74e6d None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:20.155367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf497-4fc6-479c-a8e6-6a14b5e74e6d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:20.155677 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf497-4fc6-479c-a8e6-6a14b5e74e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:20.157074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf497-4fc6-479c-a8e6-6a14b5e74e6d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:20.165337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 583/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Wed May 25 13:38:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:22.379141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1770c-b6b8-42c4-9351-25c7cd7b6636 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:22.379727 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1770c-b6b8-42c4-9351-25c7cd7b6636 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:22.379727 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1770c-b6b8-42c4-9351-25c7cd7b6636 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:22.381064 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 584/1167] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:22.386989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7d690-3523-471e-91d7-4bc4c82129dd None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:22.387400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7d690-3523-471e-91d7-4bc4c82129dd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:22.387552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7d690-3523-471e-91d7-4bc4c82129dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:22.407395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-5cb7d690-3523-471e-91d7-4bc4c82129dd None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:22.408597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-5cb7d690-3523-471e-91d7-4bc4c82129dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:22.470560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:22.480279 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 584/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:38:22.503662 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1770c-b6b8-42c4-9351-25c7cd7b6636 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:22.591759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:22.613910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1770c-b6b8-42c4-9351-25c7cd7b6636 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:22.650411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba487b5f-2983-4ca0-9505-ab03f754048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:22.650988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487b5f-2983-4ca0-9505-ab03f754048e None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:22.651277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487b5f-2983-4ca0-9505-ab03f754048e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:22.651557 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487b5f-2983-4ca0-9505-ab03f754048e None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:22.652309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba487b5f-2983-4ca0-9505-ab03f754048e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:22.653688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba487b5f-2983-4ca0-9505-ab03f754048e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:22.669211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 585/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Wed May 25 13:38:22 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:38:24.959390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663bb31-1ecc-4b6c-a1c1-b201b3887b91 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:24.959914 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663bb31-1ecc-4b6c-a1c1-b201b3887b91 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:24.959914 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663bb31-1ecc-4b6c-a1c1-b201b3887b91 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:24.962233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 585/1170] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:24.967619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80533ddf-3b0e-4288-a072-4ad02e4799ba None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:24.968051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80533ddf-3b0e-4288-a072-4ad02e4799ba None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:24.968193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80533ddf-3b0e-4288-a072-4ad02e4799ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:24.984649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-80533ddf-3b0e-4288-a072-4ad02e4799ba None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:24.985882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-80533ddf-3b0e-4288-a072-4ad02e4799ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:25.057671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 586/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:25.081289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663bb31-1ecc-4b6c-a1c1-b201b3887b91 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:25.182828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663bb31-1ecc-4b6c-a1c1-b201b3887b91 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:25.215873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b99fa-9da7-42f8-b317-ac5014dd4624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:25.216731 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b99fa-9da7-42f8-b317-ac5014dd4624 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:25.217014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b99fa-9da7-42f8-b317-ac5014dd4624 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:25.217295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b99fa-9da7-42f8-b317-ac5014dd4624 None admin] PATH_INFO: `/v3/domains/292888b1142a42e0ac866b7861e38e33` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:25.227459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b99fa-9da7-42f8-b317-ac5014dd4624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=292888b1142a42e0ac866b7861e38e33)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:25.228924 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b99fa-9da7-42f8-b317-ac5014dd4624 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:25.230587 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 586/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Wed May 25 13:38:25 2022] GET /identity/v3/domains/292888b1142a42e0ac866b7861e38e33 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:25.236491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80533ddf-3b0e-4288-a072-4ad02e4799ba None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:25.302545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:25.336538 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80533ddf-3b0e-4288-a072-4ad02e4799ba None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:25.369132 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471dfbc-db0c-4d3d-a4eb-4356d0eeb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:25.369808 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471dfbc-db0c-4d3d-a4eb-4356d0eeb4a3 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:25.370092 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471dfbc-db0c-4d3d-a4eb-4356d0eeb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:25.370366 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471dfbc-db0c-4d3d-a4eb-4356d0eeb4a3 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:25.371074 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471dfbc-db0c-4d3d-a4eb-4356d0eeb4a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:25.372511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471dfbc-db0c-4d3d-a4eb-4356d0eeb4a3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:25.397888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 587/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:38:25 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:38:27.621614 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1f2df-86a6-485e-834c-e3300a6e138f None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:27.622539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1f2df-86a6-485e-834c-e3300a6e138f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:27.622974 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1f2df-86a6-485e-834c-e3300a6e138f None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:27.624987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 587/1174] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:27.630944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0094ff-2ba6-4a65-b73b-1b976e335c9d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:27.631452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0094ff-2ba6-4a65-b73b-1b976e335c9d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:27.631546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0094ff-2ba6-4a65-b73b-1b976e335c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:27.649091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9b0094ff-2ba6-4a65-b73b-1b976e335c9d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:27.650347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9b0094ff-2ba6-4a65-b73b-1b976e335c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:27.718045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 588/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:27.744100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1f2df-86a6-485e-834c-e3300a6e138f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:27.805743 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:27.851855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1f2df-86a6-485e-834c-e3300a6e138f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:27.884993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686d5e-20b7-41a1-bee2-5bbb6210b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:27.885808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686d5e-20b7-41a1-bee2-5bbb6210b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:27.886098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686d5e-20b7-41a1-bee2-5bbb6210b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:27.886374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686d5e-20b7-41a1-bee2-5bbb6210b7c2 None admin] PATH_INFO: `/v3/domains/292888b1142a42e0ac866b7861e38e33` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:27.887561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21686d5e-20b7-41a1-bee2-5bbb6210b7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=292888b1142a42e0ac866b7861e38e33)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:27.889018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21686d5e-20b7-41a1-bee2-5bbb6210b7c2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:27.890708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 588/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Wed May 25 13:38:27 2022] GET /identity/v3/domains/292888b1142a42e0ac866b7861e38e33 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:27.901154 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0094ff-2ba6-4a65-b73b-1b976e335c9d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:27.989851 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:28.066947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0094ff-2ba6-4a65-b73b-1b976e335c9d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:28.117855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da709906-dc43-4e39-8706-4c1ba83fecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:28.118534 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709906-dc43-4e39-8706-4c1ba83fecbd None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:28.118829 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709906-dc43-4e39-8706-4c1ba83fecbd None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:28.119137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709906-dc43-4e39-8706-4c1ba83fecbd None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:28.119905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da709906-dc43-4e39-8706-4c1ba83fecbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:28.121407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da709906-dc43-4e39-8706-4c1ba83fecbd None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:28.141467 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 589/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:38:27 2022] POST /identity/v3/users => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:38:30.400977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade432-79b9-4880-a3b2-ef11feb996ec None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:30.401510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade432-79b9-4880-a3b2-ef11feb996ec None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:30.401641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade432-79b9-4880-a3b2-ef11feb996ec None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:30.403011 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 589/1178] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:30.408553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef3c0c-4cb0-4e7d-9950-a6b440296a47 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:30.409058 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef3c0c-4cb0-4e7d-9950-a6b440296a47 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:30.409188 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef3c0c-4cb0-4e7d-9950-a6b440296a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:30.427081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-cfef3c0c-4cb0-4e7d-9950-a6b440296a47 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:30.428379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-cfef3c0c-4cb0-4e7d-9950-a6b440296a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:30.497431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 590/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:30.522005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ade432-79b9-4880-a3b2-ef11feb996ec None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:30.621288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ade432-79b9-4880-a3b2-ef11feb996ec None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:30.643367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:30.658263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b30a6-f488-4d9f-80cf-d10a614d559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:30.658977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b30a6-f488-4d9f-80cf-d10a614d559e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:30.659264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b30a6-f488-4d9f-80cf-d10a614d559e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:30.659545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b30a6-f488-4d9f-80cf-d10a614d559e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:30.669946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b30a6-f488-4d9f-80cf-d10a614d559e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-c40b30a6-f488-4d9f-80cf-d10a614d559e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:38:30.677508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:38:30.678655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:38:30.680343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 590/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:38:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:38:30.685334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef3c0c-4cb0-4e7d-9950-a6b440296a47 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:30.725930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:30.792538 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef3c0c-4cb0-4e7d-9950-a6b440296a47 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:30.832546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:30.833702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:30.834282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:30.834800 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:30.836513 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:30.837098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:30.839753 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:30.848663 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 591/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:30.855747 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b30a6-f488-4d9f-80cf-d10a614d559e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:30.954307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b30a6-f488-4d9f-80cf-d10a614d559e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:30.988528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28502506-22fd-44e7-a97b-2fa0f409f75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:30.989402 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28502506-22fd-44e7-a97b-2fa0f409f75b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:30.989693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28502506-22fd-44e7-a97b-2fa0f409f75b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:30.990004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28502506-22fd-44e7-a97b-2fa0f409f75b None admin] PATH_INFO: `/v3/users/106f185bcc0a4433a3b0fbc51257c4da` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:31.003719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28502506-22fd-44e7-a97b-2fa0f409f75b None admin] RBAC: Authorizing `identity:get_user(user_id=106f185bcc0a4433a3b0fbc51257c4da)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:31.005205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28502506-22fd-44e7-a97b-2fa0f409f75b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:31.006943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 591/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:38:30 2022] GET /identity/v3/users/106f185bcc0a4433a3b0fbc51257c4da => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:31.012797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:31.110279 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:31.113579 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc67ef5-2d1e-4257-9818-5352ea679a05 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:31.154240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7390bf7-55e3-4b9a-82e9-984574f29d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:31.154895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7390bf7-55e3-4b9a-82e9-984574f29d05 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:31.155182 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7390bf7-55e3-4b9a-82e9-984574f29d05 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:31.155460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7390bf7-55e3-4b9a-82e9-984574f29d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:31.221409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7390bf7-55e3-4b9a-82e9-984574f29d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:31.222840 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7390bf7-55e3-4b9a-82e9-984574f29d05 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:31.314061 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:31.318389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 592/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:38:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:38:31.323719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28502506-22fd-44e7-a97b-2fa0f409f75b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:31.365936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:31.422755 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28502506-22fd-44e7-a97b-2fa0f409f75b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:31.455910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f68f67-d14c-45bf-b729-9b163250ce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:31.456768 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68f67-d14c-45bf-b729-9b163250ce78 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:31.457051 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68f67-d14c-45bf-b729-9b163250ce78 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:31.457331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68f67-d14c-45bf-b729-9b163250ce78 None admin] PATH_INFO: `/v3/projects/a04331bdc1614731b98520f2ce485afe` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:31.458522 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f68f67-d14c-45bf-b729-9b163250ce78 None admin] RBAC: Authorizing `identity:get_project(project_id=a04331bdc1614731b98520f2ce485afe)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:31.459970 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f68f67-d14c-45bf-b729-9b163250ce78 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:31.462486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 592/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:38:31 2022] GET /identity/v3/projects/a04331bdc1614731b98520f2ce485afe => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:31.468603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7390bf7-55e3-4b9a-82e9-984574f29d05 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:31.563193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7390bf7-55e3-4b9a-82e9-984574f29d05 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:31.596352 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59c14d-12d3-40c3-87d7-5cebcd289343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:31.596994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c14d-12d3-40c3-87d7-5cebcd289343 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:31.597280 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c14d-12d3-40c3-87d7-5cebcd289343 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:31.597558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c14d-12d3-40c3-87d7-5cebcd289343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:31.598410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59c14d-12d3-40c3-87d7-5cebcd289343 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=a04331bdc1614731b98520f2ce485afe, user.id=106f185bcc0a4433a3b0fbc51257c4da) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:31.598727 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59c14d-12d3-40c3-87d7-5cebcd289343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:31.600147 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59c14d-12d3-40c3-87d7-5cebcd289343 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:31.605459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 593/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:38:31 2022] GET /identity/v3/role_assignments?user.id=106f185bcc0a4433a3b0fbc51257c4da&scope.project.id=a04331bdc1614731b98520f2ce485afe&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:33.754779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30b2c-98eb-420f-bf25-dfbf04c8a560 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:33.755317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30b2c-98eb-420f-bf25-dfbf04c8a560 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:33.755317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30b2c-98eb-420f-bf25-dfbf04c8a560 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:33.756707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 593/1186] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:33.762612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a47e-d8e4-4fd2-9cd5-60ce50321f09 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:33.763042 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a47e-d8e4-4fd2-9cd5-60ce50321f09 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:33.763178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a47e-d8e4-4fd2-9cd5-60ce50321f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:33.779588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-ba24a47e-d8e4-4fd2-9cd5-60ce50321f09 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:33.780844 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-ba24a47e-d8e4-4fd2-9cd5-60ce50321f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:33.838959 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:33.847846 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 594/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:33.871264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30b2c-98eb-420f-bf25-dfbf04c8a560 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:33.971360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30b2c-98eb-420f-bf25-dfbf04c8a560 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:33.982777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:34.008721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934b3c-02ee-4e87-98d8-f82af7e70288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:34.009426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934b3c-02ee-4e87-98d8-f82af7e70288 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:34.009714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934b3c-02ee-4e87-98d8-f82af7e70288 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:34.010033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934b3c-02ee-4e87-98d8-f82af7e70288 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:34.020172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a934b3c-02ee-4e87-98d8-f82af7e70288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-7a934b3c-02ee-4e87-98d8-f82af7e70288 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:38:34.027766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:38:34.028947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:38:34.030050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 594/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:38:34.035091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24a47e-d8e4-4fd2-9cd5-60ce50321f09 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:34.132353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24a47e-d8e4-4fd2-9cd5-60ce50321f09 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:34.166251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:34.166921 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:34.167212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:34.167495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:34.168246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:34.168559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:34.169952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:34.177949 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 595/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:34.183915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934b3c-02ee-4e87-98d8-f82af7e70288 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:34.281718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934b3c-02ee-4e87-98d8-f82af7e70288 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:34.314693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c7f8a-98fc-410e-9ba9-047899e3e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:34.315563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c7f8a-98fc-410e-9ba9-047899e3e739 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:34.315851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c7f8a-98fc-410e-9ba9-047899e3e739 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:34.316130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c7f8a-98fc-410e-9ba9-047899e3e739 None admin] PATH_INFO: `/v3/users/106f185bcc0a4433a3b0fbc51257c4da` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:34.317309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c7f8a-98fc-410e-9ba9-047899e3e739 None admin] RBAC: Authorizing `identity:get_user(user_id=106f185bcc0a4433a3b0fbc51257c4da)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:34.318786 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c7f8a-98fc-410e-9ba9-047899e3e739 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:34.320582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 595/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:38:34 2022] GET /identity/v3/users/106f185bcc0a4433a3b0fbc51257c4da => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:34.326438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:34.383565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:34.426518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0f29e-878d-475d-9449-96eb653a71c6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:34.457642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001ee37-231b-4c1b-8952-ca77de0d18af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:34.458519 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ee37-231b-4c1b-8952-ca77de0d18af None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:34.458805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ee37-231b-4c1b-8952-ca77de0d18af None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:34.459084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ee37-231b-4c1b-8952-ca77de0d18af None admin] PATH_INFO: `/v3/projects/a04331bdc1614731b98520f2ce485afe` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:34.460760 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001ee37-231b-4c1b-8952-ca77de0d18af None admin] RBAC: Authorizing `identity:get_project(project_id=a04331bdc1614731b98520f2ce485afe)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:34.462495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001ee37-231b-4c1b-8952-ca77de0d18af None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:34.464193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 596/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:38:34 2022] GET /identity/v3/projects/a04331bdc1614731b98520f2ce485afe => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:34.470289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c7f8a-98fc-410e-9ba9-047899e3e739 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:34.504562 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:34.567577 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c7f8a-98fc-410e-9ba9-047899e3e739 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:34.600960 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba4dd2-047d-4901-9f1a-0aee9d047eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:34.601863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4dd2-047d-4901-9f1a-0aee9d047eeb None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:34.602154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4dd2-047d-4901-9f1a-0aee9d047eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:34.602428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4dd2-047d-4901-9f1a-0aee9d047eeb None admin] PATH_INFO: `/v3/projects/a04331bdc1614731b98520f2ce485afe/users/106f185bcc0a4433a3b0fbc51257c4da/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:34.604350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba4dd2-047d-4901-9f1a-0aee9d047eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=a04331bdc1614731b98520f2ce485afe, user_id=106f185bcc0a4433a3b0fbc51257c4da, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:34.605828 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba4dd2-047d-4901-9f1a-0aee9d047eeb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:34.618363 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 596/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:38:34 2022] PUT /identity/v3/projects/a04331bdc1614731b98520f2ce485afe/users/106f185bcc0a4433a3b0fbc51257c4da/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:38:36.794437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695c48-327a-4bba-8c8e-b48f97e4be73 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:36.794886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695c48-327a-4bba-8c8e-b48f97e4be73 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:36.795007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695c48-327a-4bba-8c8e-b48f97e4be73 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:36.796382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 597/1193] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:38:36.801718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5930-3cc7-40e2-984b-3e0e5d9cd410 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:36.802159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5930-3cc7-40e2-984b-3e0e5d9cd410 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:36.802305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5930-3cc7-40e2-984b-3e0e5d9cd410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:36.822487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-38fe5930-3cc7-40e2-984b-3e0e5d9cd410 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:38:36.824286 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-38fe5930-3cc7-40e2-984b-3e0e5d9cd410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:38:36.891398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 597/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:38:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:38:36.914999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695c48-327a-4bba-8c8e-b48f97e4be73 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:37.017660 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695c48-327a-4bba-8c8e-b48f97e4be73 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:37.042304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:37.053389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bfb58-5562-44c2-a7d6-20c813150dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:37.054898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bfb58-5562-44c2-a7d6-20c813150dfe None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:37.055205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bfb58-5562-44c2-a7d6-20c813150dfe None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:37.055488 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bfb58-5562-44c2-a7d6-20c813150dfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:37.065312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bfb58-5562-44c2-a7d6-20c813150dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-b75bfb58-5562-44c2-a7d6-20c813150dfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:38:37.072905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:38:37.074060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:38:37.075216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 598/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:38:37.080195 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5930-3cc7-40e2-984b-3e0e5d9cd410 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:37.108193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:37.186778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5930-3cc7-40e2-984b-3e0e5d9cd410 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:37.230004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:37.230686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:37.230978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:37.231264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:37.232019 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:37.232334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:37.233763 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:37.242076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 598/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:37.247875 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bfb58-5562-44c2-a7d6-20c813150dfe None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:37.346605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bfb58-5562-44c2-a7d6-20c813150dfe None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:37.379930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7ceac-8316-4234-8f0e-e4a1a323e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:37.380801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ceac-8316-4234-8f0e-e4a1a323e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:37.381089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ceac-8316-4234-8f0e-e4a1a323e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:37.381369 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ceac-8316-4234-8f0e-e4a1a323e3c7 None admin] PATH_INFO: `/v3/users/106f185bcc0a4433a3b0fbc51257c4da` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:37.382637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7ceac-8316-4234-8f0e-e4a1a323e3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=106f185bcc0a4433a3b0fbc51257c4da)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:37.384096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7ceac-8316-4234-8f0e-e4a1a323e3c7 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:37.385792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 599/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Wed May 25 13:38:37 2022] GET /identity/v3/users/106f185bcc0a4433a3b0fbc51257c4da => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:37.391610 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:37.479385 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:37.491332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218a41-918d-46a9-9bf6-6af65cf328ad None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:37.524070 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d6cbd-15d0-48d6-a824-aa10fc3438eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:37.524714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6cbd-15d0-48d6-a824-aa10fc3438eb None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:37.524997 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6cbd-15d0-48d6-a824-aa10fc3438eb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:37.525270 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6cbd-15d0-48d6-a824-aa10fc3438eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:37.590996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d6cbd-15d0-48d6-a824-aa10fc3438eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:37.592462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d6cbd-15d0-48d6-a824-aa10fc3438eb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:37.674887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:37.687311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 599/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:38:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:38:37.693334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7ceac-8316-4234-8f0e-e4a1a323e3c7 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:37.746933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:37.797661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7ceac-8316-4234-8f0e-e4a1a323e3c7 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:37.834410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377fb27-0c8c-41df-a644-7ee43d5231a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:37.835908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377fb27-0c8c-41df-a644-7ee43d5231a4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:37.836457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377fb27-0c8c-41df-a644-7ee43d5231a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:37.836734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377fb27-0c8c-41df-a644-7ee43d5231a4 None admin] PATH_INFO: `/v3/projects/a04331bdc1614731b98520f2ce485afe` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:37.838028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377fb27-0c8c-41df-a644-7ee43d5231a4 None admin] RBAC: Authorizing `identity:get_project(project_id=a04331bdc1614731b98520f2ce485afe)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:37.839497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377fb27-0c8c-41df-a644-7ee43d5231a4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:37.841302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 600/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Wed May 25 13:38:37 2022] GET /identity/v3/projects/a04331bdc1614731b98520f2ce485afe => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:37.847799 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d6cbd-15d0-48d6-a824-aa10fc3438eb None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:38:37.952393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d6cbd-15d0-48d6-a824-aa10fc3438eb None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:38:37.997276 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af887d2f-6e41-463c-a5bd-a1b93051b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:38:37.997982 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af887d2f-6e41-463c-a5bd-a1b93051b7fe None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:38:37.998275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af887d2f-6e41-463c-a5bd-a1b93051b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:38:37.998561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af887d2f-6e41-463c-a5bd-a1b93051b7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:38:37.999409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af887d2f-6e41-463c-a5bd-a1b93051b7fe None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=a04331bdc1614731b98520f2ce485afe, user.id=106f185bcc0a4433a3b0fbc51257c4da) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:38:37.999729 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af887d2f-6e41-463c-a5bd-a1b93051b7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:38:38.001202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af887d2f-6e41-463c-a5bd-a1b93051b7fe None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:38:38.008462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 600/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:38:37 2022] GET /identity/v3/role_assignments?user.id=106f185bcc0a4433a3b0fbc51257c4da&scope.project.id=a04331bdc1614731b98520f2ce485afe&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:38:47.829990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=40 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:38:48.004798 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=74 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:40.636531 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1373d-ade2-4929-9464-1f870de0d409 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.637277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1373d-ade2-4929-9464-1f870de0d409 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.637277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1373d-ade2-4929-9464-1f870de0d409 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.639301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 601/1201] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:40.647633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e76b-2e7f-49d6-b5cf-315c1267ab8e None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:40.648227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e76b-2e7f-49d6-b5cf-315c1267ab8e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:40.648632 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e76b-2e7f-49d6-b5cf-315c1267ab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:40.676577 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-8577e76b-2e7f-49d6-b5cf-315c1267ab8e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:40.679407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-8577e76b-2e7f-49d6-b5cf-315c1267ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:40.813780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 601/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:39:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:39:40.853697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1373d-ade2-4929-9464-1f870de0d409 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:41.048043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1373d-ade2-4929-9464-1f870de0d409 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:41.134721 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:41.136204 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:41.136640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:41.137111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:41.160982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:41.164470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:41.199194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:41.201094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:41.202725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:41.202725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:41.202725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:41.202725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:39:41.202725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 602/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:41.208558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e76b-2e7f-49d6-b5cf-315c1267ab8e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:41.395796 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e76b-2e7f-49d6-b5cf-315c1267ab8e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:41.431278 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:41.438702 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a93412-234e-410f-a52a-76c5b4c9206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:41.439411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a93412-234e-410f-a52a-76c5b4c9206e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:41.439693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a93412-234e-410f-a52a-76c5b4c9206e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:41.440016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a93412-234e-410f-a52a-76c5b4c9206e None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:41.440773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a93412-234e-410f-a52a-76c5b4c9206e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:41.441078 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a93412-234e-410f-a52a-76c5b4c9206e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:41.442606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a93412-234e-410f-a52a-76c5b4c9206e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:41.456352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 602/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:41.463368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:41.548920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:41.642673 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e54fb-8a36-4211-b4a7-c15e1de5f7d5 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:41.697950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60adb8-4079-4907-817c-c8ccf43b6211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:41.698809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60adb8-4079-4907-817c-c8ccf43b6211 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:41.699172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60adb8-4079-4907-817c-c8ccf43b6211 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:41.699467 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60adb8-4079-4907-817c-c8ccf43b6211 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:41.700167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60adb8-4079-4907-817c-c8ccf43b6211 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:41.702045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60adb8-4079-4907-817c-c8ccf43b6211 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:41.731389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 603/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Wed May 25 13:39:41 2022] POST /identity/v3/users => generated 251 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:39:44.816947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a674c-89cf-45bf-b918-e3946c2537b1 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.818429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a674c-89cf-45bf-b918-e3946c2537b1 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.818429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a674c-89cf-45bf-b918-e3946c2537b1 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.819690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 603/1206] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:44.828515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d8a5-5229-44c0-b0f6-4c3efa5a42e3 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:44.829363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d8a5-5229-44c0-b0f6-4c3efa5a42e3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:44.829363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d8a5-5229-44c0-b0f6-4c3efa5a42e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:44.858319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-8292d8a5-5229-44c0-b0f6-4c3efa5a42e3 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:44.860634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-8292d8a5-5229-44c0-b0f6-4c3efa5a42e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:44.981007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 604/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:39:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:39:45.013593 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a674c-89cf-45bf-b918-e3946c2537b1 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:45.201221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a674c-89cf-45bf-b918-e3946c2537b1 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:45.263627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3cd1-70be-44f0-b74c-ef8963fd325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:45.264667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3cd1-70be-44f0-b74c-ef8963fd325a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.265104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3cd1-70be-44f0-b74c-ef8963fd325a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.265498 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3cd1-70be-44f0-b74c-ef8963fd325a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.283815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3cd1-70be-44f0-b74c-ef8963fd325a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-f0de3cd1-70be-44f0-b74c-ef8963fd325a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:45.295133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:45.297020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:39:45.298659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:45.304901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 604/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:45.306306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d8a5-5229-44c0-b0f6-4c3efa5a42e3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:45.369067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:45.471705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d8a5-5229-44c0-b0f6-4c3efa5a42e3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:45.536292 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:45.537623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.537959 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.538312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.539131 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:45.539436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:45.541042 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:45.551521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 605/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:45.558609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3cd1-70be-44f0-b74c-ef8963fd325a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:45.640850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:45.728757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3cd1-70be-44f0-b74c-ef8963fd325a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:45.781980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:45.782820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:45.783214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:45.783517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:45.797173 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:45.798792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:45.825547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:45.828256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:45.829287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:45.829287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:45.829287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:45.829287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:45.829287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 605/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:45.834764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:45.977291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:45.980822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e16ac-fe46-49b1-83ba-dcb72aca44f0 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:46.038283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:46.039731 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:46.040448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:46.041237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:46.042635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:46.043392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:46.046283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:46.062743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 606/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:46.069309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:46.203744 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab42b69-3086-4f7d-aa1e-ddb6d226b198 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:46.205907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:46.263093 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:46.264439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:46.264877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:46.265382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] PATH_INFO: `/v3/users/placement` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:46.278274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:46.280838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:39:46.307135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:46.309284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:46.311264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 606/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:46.319288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:46.487930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31483e3-9244-4851-95ac-99fdad72747c None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:46.539376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:46.539956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:46.540292 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:46.540552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:46.546339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:46.546339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:46.546339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:46.568584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 607/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Wed May 25 13:39:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:46.575230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:46.774199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f562d-6128-4478-af9a-8a5c449debbd None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:46.850575 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89301b-9aff-4270-8ae5-c5e65c3c8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:46.851560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89301b-9aff-4270-8ae5-c5e65c3c8144 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:46.851723 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89301b-9aff-4270-8ae5-c5e65c3c8144 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:46.852095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89301b-9aff-4270-8ae5-c5e65c3c8144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:46.911039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:46.990653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89301b-9aff-4270-8ae5-c5e65c3c8144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:46.993966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89301b-9aff-4270-8ae5-c5e65c3c8144 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:47.179264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 607/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:39:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:39:47.186936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:47.218561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:47.401928 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b0a0c-49d6-4bf5-b010-ee36667e5d64 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:47.465689 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:47.466585 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:47.466907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:47.467238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:47.482155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:47.484036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:47.513804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:47.524578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:47.526509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:47.526509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:47.526509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:47.526509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:39:47.526509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 608/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:47.530068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89301b-9aff-4270-8ae5-c5e65c3c8144 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:47.662416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:47.722268 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89301b-9aff-4270-8ae5-c5e65c3c8144 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:47.783261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:47.785052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:47.785564 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:47.786193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:47.787807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:47.788725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:47.792642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:47.820010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 608/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:47.827656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:47.934684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:48.002480 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92e24-fe76-47b5-a72e-a06e02f63704 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:48.062716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:48.063699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:48.064046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:48.064212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:48.072499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:48.074026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:39:48.095023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:48.097162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:39:48.099936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 609/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:48.104380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:48.290084 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb7bcc-dd67-48cd-a824-11970246658b None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:48.324341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:48.345975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70914733-9ee3-4f05-a998-f0f7b37a2f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:48.347101 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70914733-9ee3-4f05-a998-f0f7b37a2f13 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:48.347596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70914733-9ee3-4f05-a998-f0f7b37a2f13 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:48.348092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70914733-9ee3-4f05-a998-f0f7b37a2f13 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:48.350204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70914733-9ee3-4f05-a998-f0f7b37a2f13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:48.351958 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70914733-9ee3-4f05-a998-f0f7b37a2f13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:48.353415 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70914733-9ee3-4f05-a998-f0f7b37a2f13 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:48.376933 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 609/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:48.384480 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:48.565825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1c12-4caf-44ac-af7a-d1fcdbdc16d0 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:48.622337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:48.633225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf186e-ec26-499c-b70f-0dbb7ae27088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:48.634283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf186e-ec26-499c-b70f-0dbb7ae27088 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:48.634777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf186e-ec26-499c-b70f-0dbb7ae27088 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:48.635276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf186e-ec26-499c-b70f-0dbb7ae27088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:48.636939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf186e-ec26-499c-b70f-0dbb7ae27088 None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=ba5bb1004bdc4e74809cc8e43b5d9e16) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:48.637488 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf186e-ec26-499c-b70f-0dbb7ae27088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:48.640316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf186e-ec26-499c-b70f-0dbb7ae27088 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:48.653791 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 610/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:39:48 2022] GET /identity/v3/role_assignments?user.id=ba5bb1004bdc4e74809cc8e43b5d9e16&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:51.255878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794b87-aa4e-4277-b1ce-6b35c627e2b8 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:51.256533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794b87-aa4e-4277-b1ce-6b35c627e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:51.257299 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794b87-aa4e-4277-b1ce-6b35c627e2b8 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:51.260545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 610/1220] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:39:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:39:51.266275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724c9a8-edbe-434b-9334-5c5b6fc09e7e None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:51.266840 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724c9a8-edbe-434b-9334-5c5b6fc09e7e None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:51.266840 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724c9a8-edbe-434b-9334-5c5b6fc09e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:51.290695 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-f724c9a8-edbe-434b-9334-5c5b6fc09e7e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:51.291936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f724c9a8-edbe-434b-9334-5c5b6fc09e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:51.383406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 611/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:39:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:39:51.420732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794b87-aa4e-4277-b1ce-6b35c627e2b8 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:51.636025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794b87-aa4e-4277-b1ce-6b35c627e2b8 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:51.705616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88701847-b3b4-47a1-8a80-c90d4ba361a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:51.706801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88701847-b3b4-47a1-8a80-c90d4ba361a0 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:51.707265 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88701847-b3b4-47a1-8a80-c90d4ba361a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:51.707740 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88701847-b3b4-47a1-8a80-c90d4ba361a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:51.728182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88701847-b3b4-47a1-8a80-c90d4ba361a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-88701847-b3b4-47a1-8a80-c90d4ba361a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:51.740870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:51.743193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:51.745052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 611/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:51.752940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724c9a8-edbe-434b-9334-5c5b6fc09e7e None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:51.924373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724c9a8-edbe-434b-9334-5c5b6fc09e7e None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:51.964016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:51.986974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:51.987719 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:51.988019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:51.988269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:51.989274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] RBAC: Adding query filter params (name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:51.989671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:51.991404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:52.011799 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 612/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:52.013709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88701847-b3b4-47a1-8a80-c90d4ba361a0 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:52.083968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:52.178758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88701847-b3b4-47a1-8a80-c90d4ba361a0 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:52.225143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:52.226174 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:52.226511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:52.227671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:52.243424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:52.245286 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:52.267988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:52.270584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:52.272726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:52.272726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:52.272726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:52.272726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:52.272726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 612/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:52.276646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:52.412738 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8606c23-b80f-4dc4-aad8-3b6c40ff8490 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:52.460112 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:52.460939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:52.461620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:52.462056 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:52.463051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:52.463484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:52.465283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:52.492108 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 613/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:52.494260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:52.650273 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:52.658809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baff8ff-078a-4c58-8bbf-b9c91b7a8bb6 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:52.735639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:52.737327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:52.737898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:52.738416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:52.755547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:52.759267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:39:52.795643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:52.796951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:52.798863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 613/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:52.806919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:52.878799 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:52.963090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259deddf-341d-4b5a-86d0-ea4a0b397f2b None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:53.014063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:53.014630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:53.014918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:53.015198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:53.016055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:53.016372 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:53.017932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:53.040778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 614/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Wed May 25 13:39:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:53.048442 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:53.193346 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d5f81-794b-420a-8120-1cc574a7c622 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:53.257138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:53.258187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:53.258608 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:53.258983 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:53.274831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:53.276972 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:53.302761 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:53.304428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:53.306424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:53.306424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:53.306424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:53.306424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:53.314220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 614/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:53.315982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:53.499176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d3a5a-1dc6-4794-8e45-acefbd9739c4 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:53.503759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:53.570908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:53.571725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:53.572101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:53.572508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:53.573402 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:53.573858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:53.575509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:53.594377 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 615/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:53.601925 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:53.614991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:53.745776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0895fe-ef62-4161-80b5-bb518c82fab1 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:53.794215 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:53.795947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:53.796595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:53.797064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:53.806460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:53.808042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:39:53.824338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:53.826281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:53.828159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 615/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:53.833545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:54.017079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6a5b4-970f-4d06-9c09-4723e002b5d0 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:54.079394 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538ac8f-8632-4d04-91fb-b3224388cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:54.080460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538ac8f-8632-4d04-91fb-b3224388cd19 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:54.080951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538ac8f-8632-4d04-91fb-b3224388cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:54.081452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538ac8f-8632-4d04-91fb-b3224388cd19 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:54.083063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538ac8f-8632-4d04-91fb-b3224388cd19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:54.084121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538ac8f-8632-4d04-91fb-b3224388cd19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:54.087122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538ac8f-8632-4d04-91fb-b3224388cd19 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:54.115348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 616/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:39:54.117232 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:54.225448 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:54.268308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a898a7f-556c-4a2b-bfc4-2692a9633807 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:54.327182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89933a8-d7a6-46d4-8558-f0572b5621c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:54.328360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89933a8-d7a6-46d4-8558-f0572b5621c7 None admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:54.328733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89933a8-d7a6-46d4-8558-f0572b5621c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:54.329138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89933a8-d7a6-46d4-8558-f0572b5621c7 None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/ba5bb1004bdc4e74809cc8e43b5d9e16/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:54.351194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89933a8-d7a6-46d4-8558-f0572b5621c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=ba5bb1004bdc4e74809cc8e43b5d9e16, role_id=8cb69f0fee6a4e7295d8a8bc1aff8d03)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:54.352993 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89933a8-d7a6-46d4-8558-f0572b5621c7 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:54.367222 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 616/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:39:54 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/ba5bb1004bdc4e74809cc8e43b5d9e16/roles/8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:39:57.332514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65995b-b860-4fdb-a633-7d1cce09d1d9 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.333439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65995b-b860-4fdb-a633-7d1cce09d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.333439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65995b-b860-4fdb-a633-7d1cce09d1d9 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.335497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 617/1233] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:39:57.342481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296263f-d916-49cb-9f91-06d60dac2992 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.343112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296263f-d916-49cb-9f91-06d60dac2992 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.343296 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296263f-d916-49cb-9f91-06d60dac2992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.366125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-a296263f-d916-49cb-9f91-06d60dac2992 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:39:57.367572 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a296263f-d916-49cb-9f91-06d60dac2992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:39:57.462075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 617/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:39:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:39:57.488196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65995b-b860-4fdb-a633-7d1cce09d1d9 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:57.526815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:57.651572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65995b-b860-4fdb-a633-7d1cce09d1d9 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:57.706781 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c4be7-fd3e-4b82-b832-422078b122f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:57.707898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c4be7-fd3e-4b82-b832-422078b122f3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.708944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c4be7-fd3e-4b82-b832-422078b122f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.709326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c4be7-fd3e-4b82-b832-422078b122f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.727457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c4be7-fd3e-4b82-b832-422078b122f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-e55c4be7-fd3e-4b82-b832-422078b122f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:39:57.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:57.739145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:39:57.740297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 618/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Wed May 25 13:39:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:39:57.749796 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296263f-d916-49cb-9f91-06d60dac2992 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:57.827807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:57.922207 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296263f-d916-49cb-9f91-06d60dac2992 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:57.980515 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:57.981968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:57.982419 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:57.983097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:57.984062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] RBAC: Adding query filter params (name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:57.984482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:57.986880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:58.000485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 618/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Wed May 25 13:39:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:58.008364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c4be7-fd3e-4b82-b832-422078b122f3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:58.126936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:58.146333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c4be7-fd3e-4b82-b832-422078b122f3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:58.187145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:58.187959 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:58.188245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:58.188525 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:58.201333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:58.202877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:58.223748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:58.233469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:58.235395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:58.235395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:58.235395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:58.235395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:39:58.235395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 619/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:58.236040 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:58.367266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1de06d-eef9-4e2d-ac65-1dad2cf54521 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:58.378601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:58.406592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:58.407393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:58.407718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:58.407957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:58.408975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:58.409317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:58.411028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:58.426239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 619/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:58.433865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:58.620762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca2677-871f-433c-bb52-8476afad4523 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:58.679444 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:58.680815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:58.681299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:58.681768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:58.686755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:58.696447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:58.699137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:39:58.722219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:58.725052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:39:58.727036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 620/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:58.731883 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:58.865293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578b9f1-2507-4e74-93f2-bfd6d73054b3 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:58.914109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:58.914702 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:58.914992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:58.915274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:58.916145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:58.916463 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:58.918131 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:58.944411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 620/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Wed May 25 13:39:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:58.951038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:59.109385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5544d7c-207d-4ca0-9190-2a5de87666c3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:59.154280 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b477cf-46b2-4bc1-afba-3aec64ea9ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:59.154888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b477cf-46b2-4bc1-afba-3aec64ea9ea6 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:59.155180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b477cf-46b2-4bc1-afba-3aec64ea9ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:59.155486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b477cf-46b2-4bc1-afba-3aec64ea9ea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:59.248175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:59.258724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b477cf-46b2-4bc1-afba-3aec64ea9ea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:59.260899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b477cf-46b2-4bc1-afba-3aec64ea9ea6 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:59.414817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 621/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:39:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 13:39:59.424401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:59.478455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:59.580194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32863ab-4a07-4338-8c89-010f49e2ed7a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:59.630381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:59.631935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:59.632502 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:59.633099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:59.650866 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:59.653001 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:39:59.676238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:39:59.678959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:39:59.681063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:39:59.681063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:39:59.681063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:39:59.681063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:39:59.681063 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 621/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:39:59.687276 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b477cf-46b2-4bc1-afba-3aec64ea9ea6 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:39:59.806551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:39:59.814509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b477cf-46b2-4bc1-afba-3aec64ea9ea6 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:39:59.876165 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:39:59.877324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:39:59.877966 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:39:59.878526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:39:59.880919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:39:59.881586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:39:59.884797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:39:59.911211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 622/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:39:59.917589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:00.043405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:00.077927 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4ce00-3847-4e45-930b-ef43b25d617a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:00.143821 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:00.144594 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.144928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.145200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.154301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:00.155819 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:40:00.172640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:00.183260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:00.185133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 622/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:00.186528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:00.339707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366920c1-4c3f-4991-af6d-28c8b581b436 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:00.402166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a571975-4057-4e11-be8a-c8a8b1cff88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:00.402959 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a571975-4057-4e11-be8a-c8a8b1cff88c None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.403376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a571975-4057-4e11-be8a-c8a8b1cff88c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.403883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a571975-4057-4e11-be8a-c8a8b1cff88c None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.405167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a571975-4057-4e11-be8a-c8a8b1cff88c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:00.405784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a571975-4057-4e11-be8a-c8a8b1cff88c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:00.407914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a571975-4057-4e11-be8a-c8a8b1cff88c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:00.428694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 623/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:00.435293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:00.603963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8138d-a3d5-42b6-a99a-70ac3beb2492 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:00.651555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdb08c-43da-45d1-bdd6-72a52b89060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:00.652849 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdb08c-43da-45d1-bdd6-72a52b89060d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:00.653240 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdb08c-43da-45d1-bdd6-72a52b89060d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:00.653778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdb08c-43da-45d1-bdd6-72a52b89060d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:00.655384 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdb08c-43da-45d1-bdd6-72a52b89060d None admin] RBAC: Adding query filter params (role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03, scope.project.id=c0b98559906540c082df06432223b497, user.id=ba5bb1004bdc4e74809cc8e43b5d9e16) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:00.655934 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdb08c-43da-45d1-bdd6-72a52b89060d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:00.658663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdb08c-43da-45d1-bdd6-72a52b89060d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:00.670351 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 623/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:40:00 2022] GET /identity/v3/role_assignments?user.id=ba5bb1004bdc4e74809cc8e43b5d9e16&scope.project.id=c0b98559906540c082df06432223b497&role.id=8cb69f0fee6a4e7295d8a8bc1aff8d03 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:03.309690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4834f-3c84-4a78-a389-f8f0b3dbae41 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.310484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4834f-3c84-4a78-a389-f8f0b3dbae41 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.310647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4834f-3c84-4a78-a389-f8f0b3dbae41 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.313093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 624/1247] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:40:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:03.324430 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c518fd-e131-4b5c-a6f4-67525e593653 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.325000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c518fd-e131-4b5c-a6f4-67525e593653 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.325575 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c518fd-e131-4b5c-a6f4-67525e593653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.334907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:03.359701 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-d5c518fd-e131-4b5c-a6f4-67525e593653 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:03.362010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-d5c518fd-e131-4b5c-a6f4-67525e593653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:03.472901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 624/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:40:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:40:03.515990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4834f-3c84-4a78-a389-f8f0b3dbae41 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:03.545296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:03.696890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4834f-3c84-4a78-a389-f8f0b3dbae41 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.748963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd4bf7-a8f0-4202-a9b7-d51c80e4f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.750719 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4bf7-a8f0-4202-a9b7-d51c80e4f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.751216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4bf7-a8f0-4202-a9b7-d51c80e4f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.751837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4bf7-a8f0-4202-a9b7-d51c80e4f5a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.765200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd4bf7-a8f0-4202-a9b7-d51c80e4f5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-14fd4bf7-a8f0-4202-a9b7-d51c80e4f5a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:03.773380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:03.775417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:03.776767 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:03.780040 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 625/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:40:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:03.781200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c518fd-e131-4b5c-a6f4-67525e593653 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:03.925655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c518fd-e131-4b5c-a6f4-67525e593653 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:03.965186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:03.972833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:03.973698 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:03.974024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:03.974371 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:03.975516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:03.976023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:03.978407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:03.994732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 625/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:04.001151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd4bf7-a8f0-4202-a9b7-d51c80e4f5a2 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.122763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:04.165991 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd4bf7-a8f0-4202-a9b7-d51c80e4f5a2 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.210235 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:04.211708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.212151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.212554 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.228493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:04.230340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:04.263160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:04.264355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:04.265558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:04.265558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:04.265558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:04.265558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:04.275009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 626/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:04.276237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.430326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba5334-b11e-4a36-a0d4-5e7064160d60 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.487483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:04.488569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.488985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.489447 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.490630 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:04.491141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:04.492959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:04.513514 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 626/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:04.523000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.688890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3eed8-f044-4486-b36a-a32a766d3e72 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.723899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:04.738716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:04.739981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.740499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.741013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.756251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:04.759061 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:40:04.788222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:04.790296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:40:04.792172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:04.799727 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 627/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:04.800980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:04.875975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:04.940935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18fde-ea42-4509-aeec-2dad1ed4207c None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:04.988695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:04.991044 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:04.991393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:04.991744 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:04.993046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:04.993466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:04.995548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:05.023317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 627/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Wed May 25 13:40:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:05.032792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:05.174983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9f6f6-5a86-4b2e-afc1-68476f23fbc3 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:05.224199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b69bf-ceec-4c90-b93c-d5c692d13b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:05.225011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b69bf-ceec-4c90-b93c-d5c692d13b05 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:05.225307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b69bf-ceec-4c90-b93c-d5c692d13b05 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:05.225594 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b69bf-ceec-4c90-b93c-d5c692d13b05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:05.318250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:05.336991 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b69bf-ceec-4c90-b93c-d5c692d13b05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:05.339598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b69bf-ceec-4c90-b93c-d5c692d13b05 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:05.470989 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 628/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:40:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:40:05.479195 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:05.661666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884798a-8c3c-4f88-97a0-57e401ef0e62 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:05.684259 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:05.715914 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:05.717133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:05.717475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:05.717781 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:05.734303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:05.736057 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:05.759333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:05.761369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:05.773290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:05.773290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:05.773290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:05.773290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:05.773290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 628/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:05.773827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b69bf-ceec-4c90-b93c-d5c692d13b05 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:05.912192 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:05.932662 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b69bf-ceec-4c90-b93c-d5c692d13b05 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:05.978951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:05.980098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:05.980596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:05.981087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:05.982477 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:05.983012 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:05.985421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:06.006528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 629/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:06.013050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:06.166759 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcbb5c-ab04-4d29-b0b1-cdfa572ca9b2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:06.229035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:06.230438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.230951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.231449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.244718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:06.247520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:40:06.275858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:06.277114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:06.278307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:40:06.278307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:40:06.278307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:40:06.278307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:40:06.278307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:40:06.278307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:40:06.278307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:06.278307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:06.278790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 629/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:06.286252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:06.441119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda9561-cb71-470d-abe7-45fa4567f171 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:06.482035 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918af60e-be4e-4892-b20c-fe34320b47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:06.482722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af60e-be4e-4892-b20c-fe34320b47b5 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.483009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af60e-be4e-4892-b20c-fe34320b47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.483288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af60e-be4e-4892-b20c-fe34320b47b5 None admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.484094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918af60e-be4e-4892-b20c-fe34320b47b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:06.484423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918af60e-be4e-4892-b20c-fe34320b47b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:06.485939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918af60e-be4e-4892-b20c-fe34320b47b5 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:06.501516 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 630/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:06.511560 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:06.550803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:06.681608 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede88cd-9630-414d-9c1b-6d9623eea63a None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:06.722956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79964-24f9-40f2-b2e9-53afe2833b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:06.723519 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79964-24f9-40f2-b2e9-53afe2833b55 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:06.723822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79964-24f9-40f2-b2e9-53afe2833b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:06.724089 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79964-24f9-40f2-b2e9-53afe2833b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:06.724978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79964-24f9-40f2-b2e9-53afe2833b55 None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=c0b98559906540c082df06432223b497, user.id=ba5bb1004bdc4e74809cc8e43b5d9e16) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:06.725297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79964-24f9-40f2-b2e9-53afe2833b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:06.726878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79964-24f9-40f2-b2e9-53afe2833b55 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:06.733219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 630/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:40:06 2022] GET /identity/v3/role_assignments?user.id=ba5bb1004bdc4e74809cc8e43b5d9e16&scope.project.id=c0b98559906540c082df06432223b497&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:09.113405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906656c3-d8af-44c2-9f26-d4dadeecfd77 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.114009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906656c3-d8af-44c2-9f26-d4dadeecfd77 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.114009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906656c3-d8af-44c2-9f26-d4dadeecfd77 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.115495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 631/1261] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:09.121281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee0f2-b212-4917-9d5a-b01ba96ab55d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.121839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee0f2-b212-4917-9d5a-b01ba96ab55d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.122000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee0f2-b212-4917-9d5a-b01ba96ab55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.139827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-841ee0f2-b212-4917-9d5a-b01ba96ab55d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:09.141098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-841ee0f2-b212-4917-9d5a-b01ba96ab55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:09.212485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 631/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:40:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:40:09.235331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906656c3-d8af-44c2-9f26-d4dadeecfd77 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.246617 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.345327 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906656c3-d8af-44c2-9f26-d4dadeecfd77 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.380635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d822f0-7082-4693-a709-f6f34d867859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.381397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d822f0-7082-4693-a709-f6f34d867859 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.381771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d822f0-7082-4693-a709-f6f34d867859 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.382106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d822f0-7082-4693-a709-f6f34d867859 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.393527 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d822f0-7082-4693-a709-f6f34d867859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-44d822f0-7082-4693-a709-f6f34d867859 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:09.401978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:09.403784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:09.405424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:09.408301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 632/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:09.410175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee0f2-b212-4917-9d5a-b01ba96ab55d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.440810 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.580508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee0f2-b212-4917-9d5a-b01ba96ab55d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.615800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.616472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.616758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.617034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.617806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:09.618117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.619535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.628584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 632/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:40:09.638422 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d822f0-7082-4693-a709-f6f34d867859 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.709423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.747848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d822f0-7082-4693-a709-f6f34d867859 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.787810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.788738 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.789203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.789631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.804214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.805725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:09.823591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:09.825724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:09.827909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:09.827909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:09.827909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:09.827909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:09.827909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 633/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:09.830727 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:09.915851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:09.937253 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb753-320a-4555-87a4-4b3d682ab72e None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:09.971847 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:09.972508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:09.972797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:09.974064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:09.974800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:09.975112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:09.976510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:09.988902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 633/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:09.995615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.108627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c2c9f-cd49-46c2-bfc6-57b192b73d15 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.130437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.147059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.147918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.148249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.148571 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.156895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.158495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:40:10.173853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:10.175521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:10.176961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 634/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:10.181994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.284669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc49c2-2dfd-49f3-9a3e-06312cc290eb None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.320166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.320909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.321236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.321553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.322517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:10.322875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.324411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.334617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.344876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 634/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:10.351477 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.472830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb926-f3ab-4732-8fdb-1e275e8e2b13 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.510995 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.511871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.512239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.512466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.526890 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.528457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:10.550354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:10.552462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:10.554272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:10.554272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:10.554272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:10.554272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:10.554272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 635/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:10.560458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.726359 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68272-6a1d-4b0f-a0df-2b15c17f3de2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:10.785977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:10.787130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:10.787635 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:10.788146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:10.789520 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:10.790127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:10.792785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:10.814154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 635/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:10.821152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:10.875596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:10.995792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ec17-788c-4ce7-b4d6-32dcb9c86940 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.052798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.054203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.054713 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.055218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.068508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.071312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:40:11.099343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:11.100505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:11.101656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:40:11.101656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:40:11.101656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:40:11.101656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:40:11.101656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:40:11.101656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:40:11.101656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:11.101656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:11.102341 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 636/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:40:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:11.107875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.175994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.222206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194340d2-821d-4d05-8f5f-845bf3e337e2 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.260777 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ce46-03ce-4f94-a65d-7d6088190b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.261381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ce46-03ce-4f94-a65d-7d6088190b73 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.261673 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ce46-03ce-4f94-a65d-7d6088190b73 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.261991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ce46-03ce-4f94-a65d-7d6088190b73 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.262801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ce46-03ce-4f94-a65d-7d6088190b73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:11.263120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ce46-03ce-4f94-a65d-7d6088190b73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.264633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ce46-03ce-4f94-a65d-7d6088190b73 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.279553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 636/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:11.286474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:11.384324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:11.394180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030c088-4c4b-4b97-97b4-3dc006baceea None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:11.438217 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2fe5-ff98-4904-bf42-b01725e79f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:11.439115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2fe5-ff98-4904-bf42-b01725e79f1c None admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:11.439399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2fe5-ff98-4904-bf42-b01725e79f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:11.439675 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2fe5-ff98-4904-bf42-b01725e79f1c None admin] PATH_INFO: `/v3/projects/c0b98559906540c082df06432223b497/users/ba5bb1004bdc4e74809cc8e43b5d9e16/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:11.441653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e2fe5-ff98-4904-bf42-b01725e79f1c None admin] RBAC: Authorizing `identity:create_grant(project_id=c0b98559906540c082df06432223b497, user_id=ba5bb1004bdc4e74809cc8e43b5d9e16, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:11.443191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e2fe5-ff98-4904-bf42-b01725e79f1c None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:11.457702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 637/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Wed May 25 13:40:11 2022] PUT /identity/v3/projects/c0b98559906540c082df06432223b497/users/ba5bb1004bdc4e74809cc8e43b5d9e16/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:40:13.759841 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f1d8-b5cb-48b2-a045-a32c148851ff None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:13.760458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f1d8-b5cb-48b2-a045-a32c148851ff None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:13.760458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f1d8-b5cb-48b2-a045-a32c148851ff None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:13.762300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 637/1274] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:13.768434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d410-b149-498d-ac6f-4d35b592a092 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:13.769026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d410-b149-498d-ac6f-4d35b592a092 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:13.769026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d410-b149-498d-ac6f-4d35b592a092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:13.789037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9b15d410-b149-498d-ac6f-4d35b592a092 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:13.790294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9b15d410-b149-498d-ac6f-4d35b592a092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:13.867115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 638/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:40:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:40:13.891138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934f1d8-b5cb-48b2-a045-a32c148851ff None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.000334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934f1d8-b5cb-48b2-a045-a32c148851ff None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.019878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:14.039252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a225c0-1dce-4a9e-a7ed-710808a40ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:14.040069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a225c0-1dce-4a9e-a7ed-710808a40ccc None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.040355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a225c0-1dce-4a9e-a7ed-710808a40ccc None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.040631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a225c0-1dce-4a9e-a7ed-710808a40ccc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.052772 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a225c0-1dce-4a9e-a7ed-710808a40ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-85a225c0-1dce-4a9e-a7ed-710808a40ccc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 13:40:14.060472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:14.061845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:14.063671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 638/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Wed May 25 13:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:14.070001 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d410-b149-498d-ac6f-4d35b592a092 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.155291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:14.177006 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d410-b149-498d-ac6f-4d35b592a092 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.214708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:14.215398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.215712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.216015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.216791 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:14.217105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:14.218545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:14.228512 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 639/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:14.235138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a225c0-1dce-4a9e-a7ed-710808a40ccc None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.347911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a225c0-1dce-4a9e-a7ed-710808a40ccc None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.386114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:14.387022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.387312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.387591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.399701 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:14.401191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:14.420111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:14.421822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:14.423192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:14.423192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:14.423192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:14.423192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:14.423192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 639/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:14.427938 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.552555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343286d-ae9b-4724-aa34-7641a6a8b521 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.609171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:14.610216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.610555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.610967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.612129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:14.612674 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:14.615314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:14.629852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 640/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:14.638624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.675465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:14.757307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f955af-d10c-4b04-8f75-51d956052cfa None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:14.798236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:14.799073 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:14.799358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:14.799633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:14.808705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:14.810313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 13:40:14.826327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:14.831955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:14.834257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 640/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:14.835167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:14.839622 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:14.973933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f23e9-ddbc-401e-af51-cdb787a9836e None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.016151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.016894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.017225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.017552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.018503 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:15.018863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.020885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.041881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 641/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Wed May 25 13:40:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:15.048413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.160222 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.172990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee5e3-a461-4801-b3ed-40e4b8e4188f None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.215140 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce27db-381b-47a2-bbc9-291228157653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.215807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce27db-381b-47a2-bbc9-291228157653 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.216096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce27db-381b-47a2-bbc9-291228157653 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.216379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce27db-381b-47a2-bbc9-291228157653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.293571 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce27db-381b-47a2-bbc9-291228157653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.295179 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce27db-381b-47a2-bbc9-291228157653 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.394231 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.406421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 641/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 13:40:15.416031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.482505 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:15.524718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6917-7570-48c8-b102-1f69c18c89c2 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.564153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.564868 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.565155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.565433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.577802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.579268 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 13:40:15.599546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:15.601189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:15.602567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 13:40:15.602567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 13:40:15.602567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 13:40:15.602567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:15.602567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 642/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:15.608129 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce27db-381b-47a2-bbc9-291228157653 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.757915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce27db-381b-47a2-bbc9-291228157653 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:15.798846 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:15.799545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:15.799831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:15.800118 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:15.800866 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:15.801210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:15.802717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:15.816792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 642/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:15.823711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:15.994691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2ff1f-af4e-474b-9adc-7433919f1e61 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.021086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:16.055181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.056540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.057052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.057449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.070853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.073196 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 13:40:16.100179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application with Lock( May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:16.101411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: ERROR keystone.server.flask.application May 25 13:40:16.102839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 643/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Wed May 25 13:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:16.108723 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.164851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:16.251553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3852-4534-41ac-b536-ae230fc2528d None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.308294 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8e230-2842-4b8e-bd97-e24a2a0acc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.309350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e230-2842-4b8e-bd97-e24a2a0acc01 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.309873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e230-2842-4b8e-bd97-e24a2a0acc01 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.310364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e230-2842-4b8e-bd97-e24a2a0acc01 None admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.311820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8e230-2842-4b8e-bd97-e24a2a0acc01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:16.312360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8e230-2842-4b8e-bd97-e24a2a0acc01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.314977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8e230-2842-4b8e-bd97-e24a2a0acc01 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.337201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 643/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Wed May 25 13:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:16.343761 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:16.524743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6a10-db8c-4c89-8632-64954e3b0126 None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:16.565670 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de45c2-b5b0-4fb1-b243-db6c2660622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:16.566371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de45c2-b5b0-4fb1-b243-db6c2660622e None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:16.566659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de45c2-b5b0-4fb1-b243-db6c2660622e None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:16.567430 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de45c2-b5b0-4fb1-b243-db6c2660622e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:16.568274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de45c2-b5b0-4fb1-b243-db6c2660622e None admin] RBAC: Adding query filter params (role.id=0432fca4ca7844c3b92bc4860d8756ec, scope.project.id=c0b98559906540c082df06432223b497, user.id=ba5bb1004bdc4e74809cc8e43b5d9e16) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:16.568589 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de45c2-b5b0-4fb1-b243-db6c2660622e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:16.570083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de45c2-b5b0-4fb1-b243-db6c2660622e None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:16.577076 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 644/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Wed May 25 13:40:16 2022] GET /identity/v3/role_assignments?user.id=ba5bb1004bdc4e74809cc8e43b5d9e16&scope.project.id=c0b98559906540c082df06432223b497&role.id=0432fca4ca7844c3b92bc4860d8756ec => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:18.937130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3265de-c5eb-433a-a6b1-52bf1178ba7f None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.938123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3265de-c5eb-433a-a6b1-52bf1178ba7f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.938123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3265de-c5eb-433a-a6b1-52bf1178ba7f None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.939309 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 644/1288] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:18.947657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b7a3-209e-4c42-8417-34ea094b2e30 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:18.948249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b7a3-209e-4c42-8417-34ea094b2e30 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:18.948249 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b7a3-209e-4c42-8417-34ea094b2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:18.970256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-5cb6b7a3-209e-4c42-8417-34ea094b2e30 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:18.971479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-5cb6b7a3-209e-4c42-8417-34ea094b2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:19.017749 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:19.059059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 645/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:40:19.082055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3265de-c5eb-433a-a6b1-52bf1178ba7f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.190398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3265de-c5eb-433a-a6b1-52bf1178ba7f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.203119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:19.230996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.231873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.232196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.232516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.233285 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.234833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:19.248397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:19.250523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:19.252390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 645/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:19.258414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b7a3-209e-4c42-8417-34ea094b2e30 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.388754 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b7a3-209e-4c42-8417-34ea094b2e30 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.429086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c179f0-e456-42be-9a55-6813c64a05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.429813 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c179f0-e456-42be-9a55-6813c64a05b0 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.430104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c179f0-e456-42be-9a55-6813c64a05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.430387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c179f0-e456-42be-9a55-6813c64a05b0 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.431135 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c179f0-e456-42be-9a55-6813c64a05b0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:19.431448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c179f0-e456-42be-9a55-6813c64a05b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.432884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c179f0-e456-42be-9a55-6813c64a05b0 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.438829 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 646/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:19.448452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:19.599581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67cc64-52d9-4ebf-abcd-da3132291d0c None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:19.647145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015392f8-01cf-42f5-892a-fd2de0321bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:19.647746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015392f8-01cf-42f5-892a-fd2de0321bad None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:19.648032 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015392f8-01cf-42f5-892a-fd2de0321bad None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:19.648313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015392f8-01cf-42f5-892a-fd2de0321bad None admin] PATH_INFO: `/v3/services` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:19.649054 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015392f8-01cf-42f5-892a-fd2de0321bad None admin] RBAC: Adding query filter params (type=placement) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:19.649366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015392f8-01cf-42f5-892a-fd2de0321bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:19.650899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015392f8-01cf-42f5-892a-fd2de0321bad None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:19.657672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 646/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Wed May 25 13:40:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:21.929538 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5398d7c-68b7-4011-8784-ebe1e65abeaf None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:21.930220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5398d7c-68b7-4011-8784-ebe1e65abeaf None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:21.930220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5398d7c-68b7-4011-8784-ebe1e65abeaf None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:21.931634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 647/1293] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:21.937888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453857b-4329-4bae-8f50-8e84aeddb556 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:21.938478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453857b-4329-4bae-8f50-8e84aeddb556 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:21.938478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453857b-4329-4bae-8f50-8e84aeddb556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:21.956832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-a453857b-4329-4bae-8f50-8e84aeddb556 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:21.958752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a453857b-4329-4bae-8f50-8e84aeddb556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:21.992054 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:22.036205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 647/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:40:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:40:22.059600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5398d7c-68b7-4011-8784-ebe1e65abeaf None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:22.098328 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:22.180903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5398d7c-68b7-4011-8784-ebe1e65abeaf None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:22.219232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed0b9f-e62e-470b-bc59-3a913f3c57a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:22.219898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0b9f-e62e-470b-bc59-3a913f3c57a3 None admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:22.220184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0b9f-e62e-470b-bc59-3a913f3c57a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:22.220461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0b9f-e62e-470b-bc59-3a913f3c57a3 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:22.221209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed0b9f-e62e-470b-bc59-3a913f3c57a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:22.222644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed0b9f-e62e-470b-bc59-3a913f3c57a3 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:22.237489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 648/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Wed May 25 13:40:22 2022] POST /identity/v3/services => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:40:24.542198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd178-b139-41d7-8f07-22dcce0674a2 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.542782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd178-b139-41d7-8f07-22dcce0674a2 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.542782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd178-b139-41d7-8f07-22dcce0674a2 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.544427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 648/1296] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:40:24.552612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c8e6-2d50-4492-8dc1-3126329d21f7 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.553158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c8e6-2d50-4492-8dc1-3126329d21f7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.553405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c8e6-2d50-4492-8dc1-3126329d21f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.576430 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9506c8e6-2d50-4492-8dc1-3126329d21f7 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:24.577817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9506c8e6-2d50-4492-8dc1-3126329d21f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:24.668651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 649/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:40:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 13:40:24.692417 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fd178-b139-41d7-8f07-22dcce0674a2 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:24.813286 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fd178-b139-41d7-8f07-22dcce0674a2 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:24.849046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:24.849888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:24.850177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:24.850452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:24.851105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:24.852501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:24.864724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:24.866688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:24.868697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 649/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:40:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 13:40:24.872500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c8e6-2d50-4492-8dc1-3126329d21f7 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:24.891113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:24.978321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c8e6-2d50-4492-8dc1-3126329d21f7 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:25.014440 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:25.015114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:25.015404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:25.015688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:25.016407 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:25.016721 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:25.018130 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:25.024250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 650/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Wed May 25 13:40:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:25.030347 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:25.062897 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:25.136615 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d94ab2-df4e-4952-a5c1-dfd0564b43b9 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:25.172132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997cda4-205b-488e-99bd-675c8a8cd40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:25.172800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997cda4-205b-488e-99bd-675c8a8cd40f None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:25.173091 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997cda4-205b-488e-99bd-675c8a8cd40f None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:25.173374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997cda4-205b-488e-99bd-675c8a8cd40f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:25.174196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997cda4-205b-488e-99bd-675c8a8cd40f None admin] RBAC: Adding query filter params (interface=public, service_id=1ddac64067964b7f9dd44bffb326b0ef, region_id=RegionOne) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:25.174512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997cda4-205b-488e-99bd-675c8a8cd40f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:25.175898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997cda4-205b-488e-99bd-675c8a8cd40f None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:25.181801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 650/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Wed May 25 13:40:25 2022] GET /identity/v3/endpoints?service_id=1ddac64067964b7f9dd44bffb326b0ef&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:25.187641 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:25.272528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:25.292113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b5bba-06cd-43b7-8f77-0e3cc0624e8f None admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:25.328610 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2944c6-6713-4042-a016-634cc10377ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:25.329184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2944c6-6713-4042-a016-634cc10377ee None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:25.329466 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2944c6-6713-4042-a016-634cc10377ee None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:25.329768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2944c6-6713-4042-a016-634cc10377ee None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:25.330449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2944c6-6713-4042-a016-634cc10377ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:25.331821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2944c6-6713-4042-a016-634cc10377ee None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:25.339588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 651/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Wed May 25 13:40:25 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:40:27.639035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e865d-8f35-46ce-a5cb-712ded9f41b7 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.639642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e865d-8f35-46ce-a5cb-712ded9f41b7 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.639642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e865d-8f35-46ce-a5cb-712ded9f41b7 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.640966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 651/1302] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:40:27.646834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebb70-d77a-48c4-9c48-cfecde836f05 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.647393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebb70-d77a-48c4-9c48-cfecde836f05 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.647393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebb70-d77a-48c4-9c48-cfecde836f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.664884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-eb9ebb70-d77a-48c4-9c48-cfecde836f05 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:40:27.666151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-eb9ebb70-d77a-48c4-9c48-cfecde836f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:40:27.736774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 652/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:40:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 13:40:27.761286 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e865d-8f35-46ce-a5cb-712ded9f41b7 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:27.871997 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:27.880141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e865d-8f35-46ce-a5cb-712ded9f41b7 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:27.925500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:27.926863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:27.927219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:27.927545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:27.928253 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:27.929701 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 13:40:27.942314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 13:40:27.944250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.get_or_create( May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application with Lock( May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self._enter() May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application return self.creator() May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application created_value = creator( May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: ERROR keystone.server.flask.application May 25 13:40:27.945965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 652/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 13:40:27.952086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebb70-d77a-48c4-9c48-cfecde836f05 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:28.082858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:28.107417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebb70-d77a-48c4-9c48-cfecde836f05 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:28.142273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696f861-ba46-4ca5-a3fe-fba542309e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:28.143000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696f861-ba46-4ca5-a3fe-fba542309e84 None admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:28.143331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696f861-ba46-4ca5-a3fe-fba542309e84 None admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:28.143654 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696f861-ba46-4ca5-a3fe-fba542309e84 None admin] PATH_INFO: `/v3/services` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:28.144415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696f861-ba46-4ca5-a3fe-fba542309e84 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:40:28.145287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696f861-ba46-4ca5-a3fe-fba542309e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:28.146737 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696f861-ba46-4ca5-a3fe-fba542309e84 None admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:28.152172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 653/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Wed May 25 13:40:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:40:28.158348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:40:28.263150 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e636411-521b-487f-8c07-c0d81f6e02f5 None admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:40:28.298482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a2ef4-567f-4927-8724-ea4d7e6fbc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:40:28.299149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2ef4-567f-4927-8724-ea4d7e6fbc92 None admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:40:28.299437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2ef4-567f-4927-8724-ea4d7e6fbc92 None admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:40:28.299721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2ef4-567f-4927-8724-ea4d7e6fbc92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:40:28.300473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a2ef4-567f-4927-8724-ea4d7e6fbc92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:40:28.301954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a2ef4-567f-4927-8724-ea4d7e6fbc92 None admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:40:28.321380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 653/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Wed May 25 13:40:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:40:38.149258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=30 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:40:38.316863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:40.430120 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf46d2-84ec-458d-9c8b-6e255dbc63e2 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.430963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf46d2-84ec-458d-9c8b-6e255dbc63e2 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.430963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf46d2-84ec-458d-9c8b-6e255dbc63e2 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.432086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 654/1307] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:40.437868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e32d2-aee9-493f-8534-1a6877c75f17 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.438675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e32d2-aee9-493f-8534-1a6877c75f17 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.438675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e32d2-aee9-493f-8534-1a6877c75f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.573029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-109e32d2-aee9-493f-8534-1a6877c75f17 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:40.574531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-109e32d2-aee9-493f-8534-1a6877c75f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:40.776628 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 654/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:41:40.836950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8ed0c-23b7-4a4d-b955-5458f93ba41d None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.837410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8ed0c-23b7-4a4d-b955-5458f93ba41d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.837677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8ed0c-23b7-4a4d-b955-5458f93ba41d None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.839270 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 655/1309] 10.222.0.13 () {54 vars in 964 bytes} [Wed May 25 13:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:40.845989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324c0a-dab6-4345-a178-83e35b7943fa None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:40.846759 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324c0a-dab6-4345-a178-83e35b7943fa None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:40.847304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324c0a-dab6-4345-a178-83e35b7943fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:40.939800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-73324c0a-dab6-4345-a178-83e35b7943fa None None] MFA Rules not processed for user `5d7bc855c20b431b9aabaee20101b79c`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:40.942012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-73324c0a-dab6-4345-a178-83e35b7943fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:40.982758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:41.090802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8ed0c-23b7-4a4d-b955-5458f93ba41d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:41.094642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-3dc8ed0c-23b7-4a4d-b955-5458f93ba41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:41.100807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 655/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Wed May 25 13:41:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:41:41.376363 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8ed0c-23b7-4a4d-b955-5458f93ba41d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:41.486966 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c551b-fa0c-4173-bf1a-855fc0e2c52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:41.487961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c551b-fa0c-4173-bf1a-855fc0e2c52e service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:41.488108 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c551b-fa0c-4173-bf1a-855fc0e2c52e service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:41.488424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c551b-fa0c-4173-bf1a-855fc0e2c52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:41.490837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-cb6c551b-fa0c-4173-bf1a-855fc0e2c52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:41.557915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:41.629353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c551b-fa0c-4173-bf1a-855fc0e2c52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:41.630873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c551b-fa0c-4173-bf1a-855fc0e2c52e service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:41.656096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 656/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:41:44.997831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0220c48-ea12-46d3-9ee5-c39536e3b7bd None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:44.998423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0220c48-ea12-46d3-9ee5-c39536e3b7bd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:44.998689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0220c48-ea12-46d3-9ee5-c39536e3b7bd None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.001172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 656/1312] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:41:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:45.009864 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4c2b-79f1-4d3c-b50d-8099c0b019b4 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.010638 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4c2b-79f1-4d3c-b50d-8099c0b019b4 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.010638 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4c2b-79f1-4d3c-b50d-8099c0b019b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.100706 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-3f4e4c2b-79f1-4d3c-b50d-8099c0b019b4 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:45.101962 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-3f4e4c2b-79f1-4d3c-b50d-8099c0b019b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:45.228867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 657/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:41:45.268009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0220c48-ea12-46d3-9ee5-c39536e3b7bd None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:45.269623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e0220c48-ea12-46d3-9ee5-c39536e3b7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:45.393636 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0220c48-ea12-46d3-9ee5-c39536e3b7bd None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:45.476015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:45.478203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d765b-3406-473f-bd63-2f63cc017dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:45.479042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d765b-3406-473f-bd63-2f63cc017dcc service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:45.479728 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d765b-3406-473f-bd63-2f63cc017dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:45.480226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d765b-3406-473f-bd63-2f63cc017dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:45.482254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-3a8d765b-3406-473f-bd63-2f63cc017dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:45.599127 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d765b-3406-473f-bd63-2f63cc017dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:45.600502 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d765b-3406-473f-bd63-2f63cc017dcc service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:45.620917 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 657/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:41:48.258184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622c66-232c-440b-a8d7-8b237fde17dd None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.258744 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622c66-232c-440b-a8d7-8b237fde17dd None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.258744 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622c66-232c-440b-a8d7-8b237fde17dd None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.260184 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 658/1315] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:48.266125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff986-8846-40e8-bc4f-1948cdabd7a0 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.266615 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff986-8846-40e8-bc4f-1948cdabd7a0 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.266712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff986-8846-40e8-bc4f-1948cdabd7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.347375 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-c9eff986-8846-40e8-bc4f-1948cdabd7a0 None None] MFA Rules not processed for user `4cbdfb14b73a4a4d85d4cad1d9888bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:48.348900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-c9eff986-8846-40e8-bc4f-1948cdabd7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:48.405172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:48.461543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 658/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:41:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:41:48.529556 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52349a-b07b-4026-a9c7-01be22b137df None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.529787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52349a-b07b-4026-a9c7-01be22b137df None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.530082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52349a-b07b-4026-a9c7-01be22b137df None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.531509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 659/1317] 10.222.0.13 () {54 vars in 964 bytes} [Wed May 25 13:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:48.539359 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834cb5-7b26-43bf-a679-7017d99da5e4 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.539656 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834cb5-7b26-43bf-a679-7017d99da5e4 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.539940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834cb5-7b26-43bf-a679-7017d99da5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.634517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-e3834cb5-7b26-43bf-a679-7017d99da5e4 None None] MFA Rules not processed for user `5d7bc855c20b431b9aabaee20101b79c`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:48.635799 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e3834cb5-7b26-43bf-a679-7017d99da5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:48.731734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 659/1318] 10.222.0.13 () {58 vars in 1061 bytes} [Wed May 25 13:41:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:41:48.741710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52349a-b07b-4026-a9c7-01be22b137df None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:48.743358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-1f52349a-b07b-4026-a9c7-01be22b137df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:48.754397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:48.870615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52349a-b07b-4026-a9c7-01be22b137df None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:48.947191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdeff00-fa5d-4064-92b6-c8f21333f9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:48.947862 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeff00-fa5d-4064-92b6-c8f21333f9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:48.948147 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeff00-fa5d-4064-92b6-c8f21333f9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:48.948421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeff00-fa5d-4064-92b6-c8f21333f9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:48.950222 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-dfdeff00-fa5d-4064-92b6-c8f21333f9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:49.018667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:49.068117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdeff00-fa5d-4064-92b6-c8f21333f9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:49.069471 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdeff00-fa5d-4064-92b6-c8f21333f9a0 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:49.088425 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 660/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:41:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:41:52.322635 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c1cc-2719-4623-a34c-1cc2d908ae6b None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.323236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c1cc-2719-4623-a34c-1cc2d908ae6b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.323236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c1cc-2719-4623-a34c-1cc2d908ae6b None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.324651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 660/1320] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:52.330470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdbe75-4a9f-4041-b46e-1396c6127e56 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.331140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdbe75-4a9f-4041-b46e-1396c6127e56 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.331140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdbe75-4a9f-4041-b46e-1396c6127e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.408894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-60cdbe75-4a9f-4041-b46e-1396c6127e56 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:52.410153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-60cdbe75-4a9f-4041-b46e-1396c6127e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:52.508977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 661/1321] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:41:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:41:52.547776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2c1cc-2719-4623-a34c-1cc2d908ae6b None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:52.549988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-32a2c1cc-2719-4623-a34c-1cc2d908ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:52.603829 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:52.660955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2c1cc-2719-4623-a34c-1cc2d908ae6b None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:52.738383 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e6c75-15b0-4640-8437-98b44e82edfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:52.739046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6c75-15b0-4640-8437-98b44e82edfe service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:52.739336 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6c75-15b0-4640-8437-98b44e82edfe service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:52.739618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6c75-15b0-4640-8437-98b44e82edfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:52.741290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-708e6c75-15b0-4640-8437-98b44e82edfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:52.841335 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:52.855806 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e6c75-15b0-4640-8437-98b44e82edfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:52.857189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e6c75-15b0-4640-8437-98b44e82edfe service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:52.876612 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 661/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:41:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:41:55.959016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22841c98-e96a-47d2-86ec-e50bfaaeabb7 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.959583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22841c98-e96a-47d2-86ec-e50bfaaeabb7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.959583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22841c98-e96a-47d2-86ec-e50bfaaeabb7 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:55.960960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 662/1323] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:55.966532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a06f-7aa8-4a49-a3e8-10a33684e6ed None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:55.966943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a06f-7aa8-4a49-a3e8-10a33684e6ed None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:55.967229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a06f-7aa8-4a49-a3e8-10a33684e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.036479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-6da3a06f-7aa8-4a49-a3e8-10a33684e6ed None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:56.037685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-6da3a06f-7aa8-4a49-a3e8-10a33684e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:56.133528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 662/1324] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:41:56.168145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22841c98-e96a-47d2-86ec-e50bfaaeabb7 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:56.169701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-22841c98-e96a-47d2-86ec-e50bfaaeabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:56.188936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.274908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22841c98-e96a-47d2-86ec-e50bfaaeabb7 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:56.352230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dc200-c232-494b-b40f-38b59b8db3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:56.352886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc200-c232-494b-b40f-38b59b8db3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:56.353170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc200-c232-494b-b40f-38b59b8db3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:56.353450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc200-c232-494b-b40f-38b59b8db3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:56.355136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-e33dc200-c232-494b-b40f-38b59b8db3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:56.427511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:56.466329 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dc200-c232-494b-b40f-38b59b8db3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:56.467799 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dc200-c232-494b-b40f-38b59b8db3e9 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:56.488105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 663/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:41:58.782438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa835c9-c1a2-4e36-8aa0-462ba292b922 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:58.782438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa835c9-c1a2-4e36-8aa0-462ba292b922 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:58.782438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa835c9-c1a2-4e36-8aa0-462ba292b922 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:58.782438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 663/1326] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:41:58.787934 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83472-e771-4bdb-8f77-731ea13f5598 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:58.788374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83472-e771-4bdb-8f77-731ea13f5598 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:58.788581 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83472-e771-4bdb-8f77-731ea13f5598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:58.854344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-8fb83472-e771-4bdb-8f77-731ea13f5598 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:41:58.855586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-8fb83472-e771-4bdb-8f77-731ea13f5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:58.953192 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 664/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:41:58.994308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa835c9-c1a2-4e36-8aa0-462ba292b922 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:41:58.995854 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-caa835c9-c1a2-4e36-8aa0-462ba292b922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:59.057234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:59.103099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa835c9-c1a2-4e36-8aa0-462ba292b922 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:41:59.177369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65a429-3c1a-43f6-bfbe-3c60df755764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:41:59.178058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a429-3c1a-43f6-bfbe-3c60df755764 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:41:59.178344 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a429-3c1a-43f6-bfbe-3c60df755764 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:41:59.178624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a429-3c1a-43f6-bfbe-3c60df755764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:41:59.180258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-0b65a429-3c1a-43f6-bfbe-3c60df755764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:41:59.286498 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:41:59.289331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65a429-3c1a-43f6-bfbe-3c60df755764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:41:59.291447 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65a429-3c1a-43f6-bfbe-3c60df755764 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:41:59.309573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 664/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:01.580574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ddf2-6514-4cec-9aa8-9079a51489e9 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:01.581148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ddf2-6514-4cec-9aa8-9079a51489e9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:01.581257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ddf2-6514-4cec-9aa8-9079a51489e9 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:01.582693 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 665/1329] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:01.588578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17024eec-a3c4-4c25-96ff-47b354c4eaf1 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:01.589062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17024eec-a3c4-4c25-96ff-47b354c4eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:01.589318 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17024eec-a3c4-4c25-96ff-47b354c4eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:01.654546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-17024eec-a3c4-4c25-96ff-47b354c4eaf1 None None] MFA Rules not processed for user `4cbdfb14b73a4a4d85d4cad1d9888bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:01.655760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-17024eec-a3c4-4c25-96ff-47b354c4eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:01.753246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 665/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:01.790631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03ddf2-6514-4cec-9aa8-9079a51489e9 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:01.792210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-0c03ddf2-6514-4cec-9aa8-9079a51489e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:01.822933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:01.897213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03ddf2-6514-4cec-9aa8-9079a51489e9 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:01.973218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61230fcc-bde1-46ac-87a8-fd53249042c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:01.973920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230fcc-bde1-46ac-87a8-fd53249042c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:01.974209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230fcc-bde1-46ac-87a8-fd53249042c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:01.974492 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230fcc-bde1-46ac-87a8-fd53249042c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:01.976161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-61230fcc-bde1-46ac-87a8-fd53249042c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:02.060488 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:02.093859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61230fcc-bde1-46ac-87a8-fd53249042c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:02.095308 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61230fcc-bde1-46ac-87a8-fd53249042c0 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:02.113561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 666/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:04.614754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7552e91-02a6-4b04-bb3c-2f20b8e88a73 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:04.615270 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7552e91-02a6-4b04-bb3c-2f20b8e88a73 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:04.615270 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7552e91-02a6-4b04-bb3c-2f20b8e88a73 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:04.616690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 666/1332] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:04.622141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712222a-00f5-4bac-9897-db5e2040934b None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:04.622569 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712222a-00f5-4bac-9897-db5e2040934b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:04.622717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712222a-00f5-4bac-9897-db5e2040934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:04.689149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-e712222a-00f5-4bac-9897-db5e2040934b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:04.690414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-e712222a-00f5-4bac-9897-db5e2040934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:04.787837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 667/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:04.823462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7552e91-02a6-4b04-bb3c-2f20b8e88a73 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:04.824991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-f7552e91-02a6-4b04-bb3c-2f20b8e88a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:04.898899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:04.939901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7552e91-02a6-4b04-bb3c-2f20b8e88a73 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:05.018083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739056ed-50d7-4688-92d6-d111f2273872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:05.018754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739056ed-50d7-4688-92d6-d111f2273872 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:05.019136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739056ed-50d7-4688-92d6-d111f2273872 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:05.019334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739056ed-50d7-4688-92d6-d111f2273872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:05.020984 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-739056ed-50d7-4688-92d6-d111f2273872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:05.149551 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739056ed-50d7-4688-92d6-d111f2273872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:05.151116 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739056ed-50d7-4688-92d6-d111f2273872 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:05.164506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:05.174151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 667/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:07.468317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ab782-b748-49c9-80ba-3b8d04aaad12 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:07.468856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ab782-b748-49c9-80ba-3b8d04aaad12 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:07.468950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ab782-b748-49c9-80ba-3b8d04aaad12 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:07.470316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 668/1335] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:07.475700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc00e5-32fb-450d-aed5-34da74af9cd9 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:07.476136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc00e5-32fb-450d-aed5-34da74af9cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:07.476323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc00e5-32fb-450d-aed5-34da74af9cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:07.540232 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-75dc00e5-32fb-450d-aed5-34da74af9cd9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:07.541436 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-75dc00e5-32fb-450d-aed5-34da74af9cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:07.636869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 668/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:07.676701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ab782-b748-49c9-80ba-3b8d04aaad12 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:07.678293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-5a0ab782-b748-49c9-80ba-3b8d04aaad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:07.718174 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:07.785555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ab782-b748-49c9-80ba-3b8d04aaad12 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:07.856969 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6ac4-0b1c-4c7a-9a10-502395480be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:07.857624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6ac4-0b1c-4c7a-9a10-502395480be0 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:07.857956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6ac4-0b1c-4c7a-9a10-502395480be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:07.858240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6ac4-0b1c-4c7a-9a10-502395480be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:07.859889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f7ed6ac4-0b1c-4c7a-9a10-502395480be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:07.941029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:07.967212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed6ac4-0b1c-4c7a-9a10-502395480be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:07.968644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed6ac4-0b1c-4c7a-9a10-502395480be0 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:07.986886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 669/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:10.602896 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353c8f9-474c-4e48-8dd3-a79129cb65cf None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:10.603422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353c8f9-474c-4e48-8dd3-a79129cb65cf None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:10.603422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353c8f9-474c-4e48-8dd3-a79129cb65cf None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:10.604801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 669/1338] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:10.609926 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75917ac2-b811-4297-85bc-9623e405c9a9 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:10.610356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75917ac2-b811-4297-85bc-9623e405c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:10.610493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75917ac2-b811-4297-85bc-9623e405c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:10.674406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-75917ac2-b811-4297-85bc-9623e405c9a9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:10.675610 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-75917ac2-b811-4297-85bc-9623e405c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:10.776824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 670/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:10.812082 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353c8f9-474c-4e48-8dd3-a79129cb65cf None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:10.815976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-9353c8f9-474c-4e48-8dd3-a79129cb65cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:10.894827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:10.927855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353c8f9-474c-4e48-8dd3-a79129cb65cf None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:10.931476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36a55c-7dd3-4179-bfdb-4e6b0c4402d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:10.932128 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a55c-7dd3-4179-bfdb-4e6b0c4402d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:10.932416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a55c-7dd3-4179-bfdb-4e6b0c4402d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:10.932700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a55c-7dd3-4179-bfdb-4e6b0c4402d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:10.934455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-6b36a55c-7dd3-4179-bfdb-4e6b0c4402d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:11.035907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36a55c-7dd3-4179-bfdb-4e6b0c4402d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:11.037359 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36a55c-7dd3-4179-bfdb-4e6b0c4402d4 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:11.056139 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 670/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:15.252950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8cfe3-30ce-4d54-aeca-2e5fa66ff8fa None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.253473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8cfe3-30ce-4d54-aeca-2e5fa66ff8fa None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.253473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8cfe3-30ce-4d54-aeca-2e5fa66ff8fa None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.254932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 671/1341] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:15.260308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1994b-d002-4143-9c12-8ff05892a43e None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.260802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1994b-d002-4143-9c12-8ff05892a43e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.260902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1994b-d002-4143-9c12-8ff05892a43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.310292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-c2d1994b-d002-4143-9c12-8ff05892a43e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:15.311418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-c2d1994b-d002-4143-9c12-8ff05892a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:15.372192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:15.397482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 671/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:15.436309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8cfe3-30ce-4d54-aeca-2e5fa66ff8fa None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:15.438630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-31c8cfe3-30ce-4d54-aeca-2e5fa66ff8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:15.452003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8cfe3-30ce-4d54-aeca-2e5fa66ff8fa None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:15.456004 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957d4bf-a799-4c3b-935d-cb0311ff54e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:15.456651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d4bf-a799-4c3b-935d-cb0311ff54e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:15.456934 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d4bf-a799-4c3b-935d-cb0311ff54e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:15.457214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d4bf-a799-4c3b-935d-cb0311ff54e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:15.467189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957d4bf-a799-4c3b-935d-cb0311ff54e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:15.468642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957d4bf-a799-4c3b-935d-cb0311ff54e0 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:15.479755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 672/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:18.476453 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a498-9d81-4e9e-ae29-1230f7e3f41f None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.476986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a498-9d81-4e9e-ae29-1230f7e3f41f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.476986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a498-9d81-4e9e-ae29-1230f7e3f41f None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.478366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 672/1344] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:18.483726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9ebb-6d3d-4d2c-b259-c14aa63cc02e None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.484161 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9ebb-6d3d-4d2c-b259-c14aa63cc02e None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.484300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9ebb-6d3d-4d2c-b259-c14aa63cc02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.514540 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9bbf9ebb-6d3d-4d2c-b259-c14aa63cc02e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:18.515765 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9bbf9ebb-6d3d-4d2c-b259-c14aa63cc02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:18.526585 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 673/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:18.573151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9a498-9d81-4e9e-ae29-1230f7e3f41f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:18.584974 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9a498-9d81-4e9e-ae29-1230f7e3f41f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:18.588897 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e06740-e3f0-4212-8184-26c8a2c168ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:18.589600 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06740-e3f0-4212-8184-26c8a2c168ac service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:18.589923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06740-e3f0-4212-8184-26c8a2c168ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:18.590209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06740-e3f0-4212-8184-26c8a2c168ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:18.599992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e06740-e3f0-4212-8184-26c8a2c168ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:18.601451 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e06740-e3f0-4212-8184-26c8a2c168ac service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:18.612169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 673/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:23.103736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf4662-2915-4c17-95f2-a862730b91ee None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:23.104320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf4662-2915-4c17-95f2-a862730b91ee None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:23.104539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf4662-2915-4c17-95f2-a862730b91ee None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:23.106191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 674/1347] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:23.111855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f738f8-a86b-40a7-9403-bd4e1a5071f9 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:23.112304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f738f8-a86b-40a7-9403-bd4e1a5071f9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:23.112454 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f738f8-a86b-40a7-9403-bd4e1a5071f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:23.130580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-e5f738f8-a86b-40a7-9403-bd4e1a5071f9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:23.131813 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e5f738f8-a86b-40a7-9403-bd4e1a5071f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:23.144978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 674/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:23.179911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf4662-2915-4c17-95f2-a862730b91ee None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:23.191315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf4662-2915-4c17-95f2-a862730b91ee None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:23.195221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3745181-13ae-41ab-b5b1-c73bed5c623c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:23.195874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745181-13ae-41ab-b5b1-c73bed5c623c service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:23.196163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745181-13ae-41ab-b5b1-c73bed5c623c service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:23.196446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745181-13ae-41ab-b5b1-c73bed5c623c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:23.207687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3745181-13ae-41ab-b5b1-c73bed5c623c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:23.209149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3745181-13ae-41ab-b5b1-c73bed5c623c service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:23.220124 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 675/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:28.765172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed16da-8455-4005-b954-7b70f78a8c81 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:28.765784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed16da-8455-4005-b954-7b70f78a8c81 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:28.765784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed16da-8455-4005-b954-7b70f78a8c81 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:28.767450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 675/1350] 10.222.0.13 () {54 vars in 921 bytes} [Wed May 25 13:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:28.772639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1504e-6b97-4c68-b17e-8f252a6d66e6 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:28.773069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1504e-6b97-4c68-b17e-8f252a6d66e6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:28.773199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1504e-6b97-4c68-b17e-8f252a6d66e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:28.788217 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:28.896823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-2cb1504e-6b97-4c68-b17e-8f252a6d66e6 None None] MFA Rules not processed for user `ba5bb1004bdc4e74809cc8e43b5d9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:28.898773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-2cb1504e-6b97-4c68-b17e-8f252a6d66e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:28.983304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 676/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Wed May 25 13:42:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:33.125024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=15 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:33.421779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb342a-7569-45f7-aa46-e08bc77351bd None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:33.422091 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb342a-7569-45f7-aa46-e08bc77351bd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:33.422555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb342a-7569-45f7-aa46-e08bc77351bd None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:33.423991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 676/1352] 10.222.0.13 () {54 vars in 921 bytes} [Wed May 25 13:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:33.429347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e1b55-423f-469a-a8ff-ab491e3d1438 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:33.429885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e1b55-423f-469a-a8ff-ab491e3d1438 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:33.430164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e1b55-423f-469a-a8ff-ab491e3d1438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:33.449224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-222e1b55-423f-469a-a8ff-ab491e3d1438 None None] MFA Rules not processed for user `ba5bb1004bdc4e74809cc8e43b5d9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:33.450688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-222e1b55-423f-469a-a8ff-ab491e3d1438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:33.461340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 677/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Wed May 25 13:42:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:34.886867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d87d-7f58-45df-b261-cc0f38674d5c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:34.887402 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d87d-7f58-45df-b261-cc0f38674d5c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:34.887500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d87d-7f58-45df-b261-cc0f38674d5c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:34.888869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 677/1354] 10.222.0.13 () {54 vars in 921 bytes} [Wed May 25 13:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:34.894950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bc45-58f6-4850-9656-69774bf0d37f None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:34.895475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bc45-58f6-4850-9656-69774bf0d37f None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:34.895635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bc45-58f6-4850-9656-69774bf0d37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:34.915448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-29e5bc45-58f6-4850-9656-69774bf0d37f None None] MFA Rules not processed for user `ba5bb1004bdc4e74809cc8e43b5d9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:34.916697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-29e5bc45-58f6-4850-9656-69774bf0d37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:34.926410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 678/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Wed May 25 13:42:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:39.036518 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c19d5-ea08-478e-bafd-40c0eb9adf64 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:39.036943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c19d5-ea08-478e-bafd-40c0eb9adf64 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:39.037070 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c19d5-ea08-478e-bafd-40c0eb9adf64 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:39.038684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 678/1356] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:39.043710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57ec9-dfc2-4c53-92db-d833dfcda4c2 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:39.044125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57ec9-dfc2-4c53-92db-d833dfcda4c2 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:39.044283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57ec9-dfc2-4c53-92db-d833dfcda4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:39.063076 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-1dd57ec9-dfc2-4c53-92db-d833dfcda4c2 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:39.064549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-1dd57ec9-dfc2-4c53-92db-d833dfcda4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:39.085755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 679/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:39.131739 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e356-f038-4b6c-9ebf-131f9f48a73e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:39.132511 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e356-f038-4b6c-9ebf-131f9f48a73e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:39.133025 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e356-f038-4b6c-9ebf-131f9f48a73e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:39.135201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 679/1358] 10.222.0.13 () {54 vars in 961 bytes} [Wed May 25 13:42:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:39.144499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee005-de0c-4e0a-ac2b-5736dd744f2f None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:39.144873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee005-de0c-4e0a-ac2b-5736dd744f2f None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:39.145237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee005-de0c-4e0a-ac2b-5736dd744f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:39.201613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-878ee005-de0c-4e0a-ac2b-5736dd744f2f None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:39.202990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-878ee005-de0c-4e0a-ac2b-5736dd744f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:39.262741 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:42:39.295007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 680/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Wed May 25 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:42:39.303714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e356-f038-4b6c-9ebf-131f9f48a73e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:39.318205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e356-f038-4b6c-9ebf-131f9f48a73e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:39.323588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb91435-aa1b-4ece-b497-6d2a8e5cf6ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:39.324235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb91435-aa1b-4ece-b497-6d2a8e5cf6ca service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:39.324518 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb91435-aa1b-4ece-b497-6d2a8e5cf6ca service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:39.324792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb91435-aa1b-4ece-b497-6d2a8e5cf6ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:39.333716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb91435-aa1b-4ece-b497-6d2a8e5cf6ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:39.335400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb91435-aa1b-4ece-b497-6d2a8e5cf6ca service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:39.345795 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 680/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:41.906613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f616a-3384-40df-b013-59eceb2873a2 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:41.907179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f616a-3384-40df-b013-59eceb2873a2 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:41.907179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f616a-3384-40df-b013-59eceb2873a2 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:41.908917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 681/1361] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:41.914513 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21a06-783f-43fe-aa31-3f242a53a872 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:41.915206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21a06-783f-43fe-aa31-3f242a53a872 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:41.915206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21a06-783f-43fe-aa31-3f242a53a872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:41.936903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-3de21a06-783f-43fe-aa31-3f242a53a872 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:41.939776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-3de21a06-783f-43fe-aa31-3f242a53a872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:41.953230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 681/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:42.001125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f616a-3384-40df-b013-59eceb2873a2 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:42.020424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f616a-3384-40df-b013-59eceb2873a2 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:42.034619 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ff08-3368-4d7c-a9c0-11254e02aee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:42.035567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ff08-3368-4d7c-a9c0-11254e02aee5 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:42.035952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ff08-3368-4d7c-a9c0-11254e02aee5 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:42.036371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ff08-3368-4d7c-a9c0-11254e02aee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:42.049136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ff08-3368-4d7c-a9c0-11254e02aee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:42.051323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ff08-3368-4d7c-a9c0-11254e02aee5 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:42.062548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 682/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:44.655967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee850b-c5c5-4809-89b8-d5e822a4b42b None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.656820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee850b-c5c5-4809-89b8-d5e822a4b42b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.657277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee850b-c5c5-4809-89b8-d5e822a4b42b None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.659540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 682/1364] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:44.665624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3685-90f1-48f5-82db-d0dfb158b64f None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.666504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3685-90f1-48f5-82db-d0dfb158b64f None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.666937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3685-90f1-48f5-82db-d0dfb158b64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.686299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-259f3685-90f1-48f5-82db-d0dfb158b64f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:44.687759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-259f3685-90f1-48f5-82db-d0dfb158b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:44.696581 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 683/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:44.741726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c78a0-e55d-481c-8d56-85470f288175 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.742077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c78a0-e55d-481c-8d56-85470f288175 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.742378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c78a0-e55d-481c-8d56-85470f288175 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.743790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 683/1366] 10.222.0.13 () {54 vars in 961 bytes} [Wed May 25 13:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:44.749137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37150fe-f27e-46a4-ab5a-3a9144e9676f None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.749431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37150fe-f27e-46a4-ab5a-3a9144e9676f None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.749763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37150fe-f27e-46a4-ab5a-3a9144e9676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.768508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b37150fe-f27e-46a4-ab5a-3a9144e9676f None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:44.769714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b37150fe-f27e-46a4-ab5a-3a9144e9676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:44.779056 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 684/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Wed May 25 13:42:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:44.787952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c78a0-e55d-481c-8d56-85470f288175 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:44.802985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c78a0-e55d-481c-8d56-85470f288175 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:44.808467 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c5ed-7d2e-44cf-8542-781a8cb97118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:44.809124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c5ed-7d2e-44cf-8542-781a8cb97118 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:44.809415 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c5ed-7d2e-44cf-8542-781a8cb97118 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:44.809793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c5ed-7d2e-44cf-8542-781a8cb97118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:44.819314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804c5ed-7d2e-44cf-8542-781a8cb97118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:44.820938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804c5ed-7d2e-44cf-8542-781a8cb97118 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:44.830733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 684/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:47.227765 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356260-88cb-483f-8a1a-18f83fafcea7 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.228452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356260-88cb-483f-8a1a-18f83fafcea7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.228542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356260-88cb-483f-8a1a-18f83fafcea7 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.232270 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 685/1369] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:42:47.243056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c39c8-f579-43f8-bd37-e2fc0e9c259a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.246021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c39c8-f579-43f8-bd37-e2fc0e9c259a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.246021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c39c8-f579-43f8-bd37-e2fc0e9c259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.275166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-072c39c8-f579-43f8-bd37-e2fc0e9c259a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:47.276418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-072c39c8-f579-43f8-bd37-e2fc0e9c259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:47.292423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 685/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:47.354809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8356260-88cb-483f-8a1a-18f83fafcea7 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:47.374230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8356260-88cb-483f-8a1a-18f83fafcea7 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:47.381121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756a375-4013-4644-b948-60e5f0ac4757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:47.381701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756a375-4013-4644-b948-60e5f0ac4757 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.382038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756a375-4013-4644-b948-60e5f0ac4757 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.382304 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756a375-4013-4644-b948-60e5f0ac4757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.394106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756a375-4013-4644-b948-60e5f0ac4757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:47.395759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756a375-4013-4644-b948-60e5f0ac4757 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:47.407746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 686/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:47.525489 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3c0e6-c809-47b8-81af-c2216954755c None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.526189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3c0e6-c809-47b8-81af-c2216954755c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.526617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3c0e6-c809-47b8-81af-c2216954755c None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.529017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 686/1372] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:42:47.537261 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc8642-7d12-4414-9a3d-9c68546a98d5 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.538200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc8642-7d12-4414-9a3d-9c68546a98d5 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.539183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc8642-7d12-4414-9a3d-9c68546a98d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.574167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b5cc8642-7d12-4414-9a3d-9c68546a98d5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:47.575736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b5cc8642-7d12-4414-9a3d-9c68546a98d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:47.590053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 687/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:42:47.886368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01258b46-7de7-4e1c-9350-64e20909adf6 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.886887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01258b46-7de7-4e1c-9350-64e20909adf6 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.887333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01258b46-7de7-4e1c-9350-64e20909adf6 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.888712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 687/1374] 10.222.0.13 () {54 vars in 963 bytes} [Wed May 25 13:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:47.895745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f375c3-a97f-4014-84ff-f7324c67f574 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:47.896038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f375c3-a97f-4014-84ff-f7324c67f574 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:47.896329 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f375c3-a97f-4014-84ff-f7324c67f574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:47.956134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-f8f375c3-a97f-4014-84ff-f7324c67f574 None None] MFA Rules not processed for user `5c27e8bab1f3424aadd7ca66a1e2756f`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:47.957445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f8f375c3-a97f-4014-84ff-f7324c67f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:48.036640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 688/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Wed May 25 13:42:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:42:48.044928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01258b46-7de7-4e1c-9350-64e20909adf6 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:48.058288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01258b46-7de7-4e1c-9350-64e20909adf6 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:48.063105 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe631e4-5523-46a5-b1d9-62cbd3c7de4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:48.064121 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe631e4-5523-46a5-b1d9-62cbd3c7de4c service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:48.064789 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe631e4-5523-46a5-b1d9-62cbd3c7de4c service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:48.065270 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe631e4-5523-46a5-b1d9-62cbd3c7de4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:48.077521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe631e4-5523-46a5-b1d9-62cbd3c7de4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:48.079355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe631e4-5523-46a5-b1d9-62cbd3c7de4c service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:48.091165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 688/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:50.150582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc627b-4343-436b-bffd-e86bc3853dee None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:50.151099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc627b-4343-436b-bffd-e86bc3853dee None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:50.151228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc627b-4343-436b-bffd-e86bc3853dee None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:50.152650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 689/1377] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:50.160807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d0b76-1d96-4e39-9854-521b3d1135a9 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:50.161271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d0b76-1d96-4e39-9854-521b3d1135a9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:50.161371 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d0b76-1d96-4e39-9854-521b3d1135a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:50.184687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-dd0d0b76-1d96-4e39-9854-521b3d1135a9 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:50.185954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-dd0d0b76-1d96-4e39-9854-521b3d1135a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:50.194579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 689/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:50.239650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc627b-4343-436b-bffd-e86bc3853dee None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:50.254305 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc627b-4343-436b-bffd-e86bc3853dee None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:50.260457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b186d-3c58-4032-8f88-bca3490a9388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:50.260595 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b186d-3c58-4032-8f88-bca3490a9388 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:50.260878 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b186d-3c58-4032-8f88-bca3490a9388 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:50.261162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b186d-3c58-4032-8f88-bca3490a9388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:50.272017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b186d-3c58-4032-8f88-bca3490a9388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:50.273712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b186d-3c58-4032-8f88-bca3490a9388 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:50.285129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 690/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:52.707895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5775d4e-0747-4b1c-8fe1-cc8dbad33bd5 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:52.708928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5775d4e-0747-4b1c-8fe1-cc8dbad33bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:52.708928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5775d4e-0747-4b1c-8fe1-cc8dbad33bd5 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:52.710759 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 690/1380] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:42:52.716810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c40b50-5780-4ce3-85e4-d399395cc2c1 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:52.717489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c40b50-5780-4ce3-85e4-d399395cc2c1 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:52.717489 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c40b50-5780-4ce3-85e4-d399395cc2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:52.736171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-74c40b50-5780-4ce3-85e4-d399395cc2c1 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:52.737413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-74c40b50-5780-4ce3-85e4-d399395cc2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:52.747744 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 691/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:52.802343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5775d4e-0747-4b1c-8fe1-cc8dbad33bd5 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:52.821335 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5775d4e-0747-4b1c-8fe1-cc8dbad33bd5 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:52.827876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca237b7f-1a25-442f-b01a-87b85d510a62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:52.828669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237b7f-1a25-442f-b01a-87b85d510a62 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:52.829122 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237b7f-1a25-442f-b01a-87b85d510a62 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:52.829981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237b7f-1a25-442f-b01a-87b85d510a62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:52.840171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca237b7f-1a25-442f-b01a-87b85d510a62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:52.842020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca237b7f-1a25-442f-b01a-87b85d510a62 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:52.854286 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 691/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:55.326317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7acc-9a42-492e-9089-dd99964cebb8 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:55.326859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7acc-9a42-492e-9089-dd99964cebb8 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:55.326859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7acc-9a42-492e-9089-dd99964cebb8 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:55.328158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 692/1383] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:55.334092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d034cf-14a9-4058-8c39-881710fd2908 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:55.334529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d034cf-14a9-4058-8c39-881710fd2908 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:55.334653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d034cf-14a9-4058-8c39-881710fd2908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:55.354561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-e8d034cf-14a9-4058-8c39-881710fd2908 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:55.355758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e8d034cf-14a9-4058-8c39-881710fd2908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:55.363839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 692/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:55.405050 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d7acc-9a42-492e-9089-dd99964cebb8 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:55.420830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d7acc-9a42-492e-9089-dd99964cebb8 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:55.427204 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462ef42-bfb6-4ea3-824a-a85cf93d029d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:55.428028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ef42-bfb6-4ea3-824a-a85cf93d029d service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:55.428450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ef42-bfb6-4ea3-824a-a85cf93d029d service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:55.428828 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ef42-bfb6-4ea3-824a-a85cf93d029d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:55.438666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462ef42-bfb6-4ea3-824a-a85cf93d029d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:55.440450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462ef42-bfb6-4ea3-824a-a85cf93d029d service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:55.452484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 693/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:42:57.711617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4027f-0227-4316-8b87-e80f2af3975d None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:57.712167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4027f-0227-4316-8b87-e80f2af3975d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:57.712167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4027f-0227-4316-8b87-e80f2af3975d None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:57.714043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 693/1386] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:42:57.719096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9b928-ef1b-419b-a9a7-396542d3932b None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:57.719502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9b928-ef1b-419b-a9a7-396542d3932b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:57.719729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9b928-ef1b-419b-a9a7-396542d3932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:57.739257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b9e9b928-ef1b-419b-a9a7-396542d3932b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:42:57.740737 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b9e9b928-ef1b-419b-a9a7-396542d3932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:42:57.751626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 694/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:42:57.806077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4027f-0227-4316-8b87-e80f2af3975d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:42:57.825492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4027f-0227-4316-8b87-e80f2af3975d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:42:57.831916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3f59-39f1-4a97-8764-f3b2324cf7f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:42:57.832813 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3f59-39f1-4a97-8764-f3b2324cf7f1 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:42:57.833189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3f59-39f1-4a97-8764-f3b2324cf7f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:42:57.833552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3f59-39f1-4a97-8764-f3b2324cf7f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:42:57.845627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f3f59-39f1-4a97-8764-f3b2324cf7f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:42:57.847822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f3f59-39f1-4a97-8764-f3b2324cf7f1 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:42:57.861899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 694/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:00.505153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9104ad-b948-403c-b0e1-f9573c17c6f2 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:00.505710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9104ad-b948-403c-b0e1-f9573c17c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:00.505710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9104ad-b948-403c-b0e1-f9573c17c6f2 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:00.507134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 695/1389] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:43:00.512586 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0a2b-34f3-4bfa-9390-017d5ea32d33 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:00.513042 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0a2b-34f3-4bfa-9390-017d5ea32d33 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:00.513186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0a2b-34f3-4bfa-9390-017d5ea32d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:00.534248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-ea4d0a2b-34f3-4bfa-9390-017d5ea32d33 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:00.535402 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ea4d0a2b-34f3-4bfa-9390-017d5ea32d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:00.544206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 695/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:00.600010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9104ad-b948-403c-b0e1-f9573c17c6f2 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:00.614787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9104ad-b948-403c-b0e1-f9573c17c6f2 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:00.620288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b35073-ce55-4be2-b622-0490d40c436c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:00.620935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b35073-ce55-4be2-b622-0490d40c436c service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:00.621228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b35073-ce55-4be2-b622-0490d40c436c service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:00.621515 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b35073-ce55-4be2-b622-0490d40c436c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:00.630164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b35073-ce55-4be2-b622-0490d40c436c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:00.631774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b35073-ce55-4be2-b622-0490d40c436c service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:00.641923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 696/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:02.910937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1cfec-21f5-480c-94ea-ab4b19361aa1 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:02.911530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1cfec-21f5-480c-94ea-ab4b19361aa1 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:02.911530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1cfec-21f5-480c-94ea-ab4b19361aa1 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:02.912889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 696/1392] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:02.918332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98a8e-28e6-46f5-86c6-6694158363f5 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:02.918801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98a8e-28e6-46f5-86c6-6694158363f5 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:02.918935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98a8e-28e6-46f5-86c6-6694158363f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:02.936406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9cd98a8e-28e6-46f5-86c6-6694158363f5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:02.937613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9cd98a8e-28e6-46f5-86c6-6694158363f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:02.945473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 697/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:02.990714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1cfec-21f5-480c-94ea-ab4b19361aa1 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:03.005218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1cfec-21f5-480c-94ea-ab4b19361aa1 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:03.010645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52746-d33e-422b-b132-5f221d9b3e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:03.011319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52746-d33e-422b-b132-5f221d9b3e63 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:03.011607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52746-d33e-422b-b132-5f221d9b3e63 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:03.011886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52746-d33e-422b-b132-5f221d9b3e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:03.021075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b52746-d33e-422b-b132-5f221d9b3e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:03.022776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b52746-d33e-422b-b132-5f221d9b3e63 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:03.033797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 697/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:04.736972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cdf4b-3fe6-46e9-9552-41eda834ce77 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:04.737572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cdf4b-3fe6-46e9-9552-41eda834ce77 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:04.737572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cdf4b-3fe6-46e9-9552-41eda834ce77 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:04.738951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 698/1395] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:04.744613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65fac8-c45e-446c-9d45-e422d9da2d1f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:04.745075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65fac8-c45e-446c-9d45-e422d9da2d1f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:04.745336 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65fac8-c45e-446c-9d45-e422d9da2d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:04.751893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=52 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:04.764717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-8c65fac8-c45e-446c-9d45-e422d9da2d1f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:04.765935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-8c65fac8-c45e-446c-9d45-e422d9da2d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:04.774303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 698/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:04.829622 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d347f-9761-4bee-a497-9c63ec46c203 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:04.829957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d347f-9761-4bee-a497-9c63ec46c203 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:04.830242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d347f-9761-4bee-a497-9c63ec46c203 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:04.831704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 699/1397] 10.222.0.13 () {54 vars in 962 bytes} [Wed May 25 13:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:04.837072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ffa7-d1b9-408d-a5e4-ba13733df974 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:04.837433 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ffa7-d1b9-408d-a5e4-ba13733df974 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:04.837837 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ffa7-d1b9-408d-a5e4-ba13733df974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:04.888890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-e391ffa7-d1b9-408d-a5e4-ba13733df974 None None] MFA Rules not processed for user `7fc89b93f03e453da2780d75216e0566`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:04.890138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e391ffa7-d1b9-408d-a5e4-ba13733df974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:04.951394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 699/1398] 10.222.0.13 () {58 vars in 1059 bytes} [Wed May 25 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:04.959208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d347f-9761-4bee-a497-9c63ec46c203 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:04.970384 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d347f-9761-4bee-a497-9c63ec46c203 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:04.974013 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b68b7-baea-47ee-b303-55778bc5d853 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc89b93f03e453da2780d75216e0566', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:04.974700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b68b7-baea-47ee-b303-55778bc5d853 service glance] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:04.974990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b68b7-baea-47ee-b303-55778bc5d853 service glance] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:04.975273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b68b7-baea-47ee-b303-55778bc5d853 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:04.986127 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b68b7-baea-47ee-b303-55778bc5d853 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:04.987623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b68b7-baea-47ee-b303-55778bc5d853 service glance] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:04.992107 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:04.999733 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 700/1399] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:05.280506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd741e1-0f24-45c9-afad-cd94ac18f901 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.280803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd741e1-0f24-45c9-afad-cd94ac18f901 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.281088 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd741e1-0f24-45c9-afad-cd94ac18f901 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.283117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 700/1400] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:05.289069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102d3a4-f1c4-402a-b726-45f57a233912 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.289360 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102d3a4-f1c4-402a-b726-45f57a233912 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.289664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102d3a4-f1c4-402a-b726-45f57a233912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.310016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-a102d3a4-f1c4-402a-b726-45f57a233912 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:05.311348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-a102d3a4-f1c4-402a-b726-45f57a233912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:05.320447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 701/1401] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:05.367238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd741e1-0f24-45c9-afad-cd94ac18f901 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:05.382855 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd741e1-0f24-45c9-afad-cd94ac18f901 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:05.389409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72c26c-51dd-4070-aae2-ad6e6a7292b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:05.390123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72c26c-51dd-4070-aae2-ad6e6a7292b1 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.390417 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72c26c-51dd-4070-aae2-ad6e6a7292b1 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.390703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72c26c-51dd-4070-aae2-ad6e6a7292b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.400744 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72c26c-51dd-4070-aae2-ad6e6a7292b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:05.402547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72c26c-51dd-4070-aae2-ad6e6a7292b1 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:05.413548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 701/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:05.567150 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2a39-18b8-4b64-87d0-617eb98dd1b9 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.567457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2a39-18b8-4b64-87d0-617eb98dd1b9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.567747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2a39-18b8-4b64-87d0-617eb98dd1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.624618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-452f2a39-18b8-4b64-87d0-617eb98dd1b9 None None] MFA Rules not processed for user `cd2f4a2f2f06432b9c9352ac707a6527`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:05.625914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-452f2a39-18b8-4b64-87d0-617eb98dd1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:05.694927 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 702/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Wed May 25 13:43:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:05.739276 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f7fa-baab-4637-ac98-ffd8d8ba24dd None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.739837 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f7fa-baab-4637-ac98-ffd8d8ba24dd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.740234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f7fa-baab-4637-ac98-ffd8d8ba24dd None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.741944 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 702/1404] 10.222.0.13 () {54 vars in 942 bytes} [Wed May 25 13:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:05.748110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432a07d-cbc5-4caa-b77c-1b1abb4b2676 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.748602 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432a07d-cbc5-4caa-b77c-1b1abb4b2676 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.748716 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432a07d-cbc5-4caa-b77c-1b1abb4b2676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.808381 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9432a07d-cbc5-4caa-b77c-1b1abb4b2676 None None] MFA Rules not processed for user `a2759d80c45b46bda24dd9509ea089ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:05.809626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9432a07d-cbc5-4caa-b77c-1b1abb4b2676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:05.904086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 703/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Wed May 25 13:43:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:43:05.915047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146f7fa-baab-4637-ac98-ffd8d8ba24dd None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:05.929563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146f7fa-baab-4637-ac98-ffd8d8ba24dd None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:05.934840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1b453-bf11-4c85-9eab-16ad9e2f2f55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2759d80c45b46bda24dd9509ea089ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:05.935513 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1b453-bf11-4c85-9eab-16ad9e2f2f55 service swift] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:05.935807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1b453-bf11-4c85-9eab-16ad9e2f2f55 service swift] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:05.936350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1b453-bf11-4c85-9eab-16ad9e2f2f55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:05.946618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1b453-bf11-4c85-9eab-16ad9e2f2f55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:05.948289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1b453-bf11-4c85-9eab-16ad9e2f2f55 service swift] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:05.959589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 703/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Wed May 25 13:43:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 13:43:07.697616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89fcfd-ed7e-4d52-9a77-2a9234730e99 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:07.698623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89fcfd-ed7e-4d52-9a77-2a9234730e99 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:07.699004 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89fcfd-ed7e-4d52-9a77-2a9234730e99 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:07.700720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 704/1407] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:07.706863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2a75-19e6-4b1f-8f52-b93e1787af7f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:07.707639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2a75-19e6-4b1f-8f52-b93e1787af7f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:07.707922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f2a75-19e6-4b1f-8f52-b93e1787af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:07.731260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-8a3f2a75-19e6-4b1f-8f52-b93e1787af7f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:07.732508 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-8a3f2a75-19e6-4b1f-8f52-b93e1787af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:07.786999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 704/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:07.867762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89fcfd-ed7e-4d52-9a77-2a9234730e99 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:07.884493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89fcfd-ed7e-4d52-9a77-2a9234730e99 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:07.892718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dae9d0-9a11-43e5-9216-bf44dacd2323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:07.902539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae9d0-9a11-43e5-9216-bf44dacd2323 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:07.902539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae9d0-9a11-43e5-9216-bf44dacd2323 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:07.902539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae9d0-9a11-43e5-9216-bf44dacd2323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:07.904294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dae9d0-9a11-43e5-9216-bf44dacd2323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:07.906106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dae9d0-9a11-43e5-9216-bf44dacd2323 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:07.917387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 705/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:17.725500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=55 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:17.912784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=94 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:29.425998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345467-a3bc-4a8a-b0d0-42be44115e94 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:29.426606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345467-a3bc-4a8a-b0d0-42be44115e94 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:29.426606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345467-a3bc-4a8a-b0d0-42be44115e94 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:29.427872 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 705/1410] 10.222.0.13 () {54 vars in 918 bytes} [Wed May 25 13:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:29.433170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603158d5-7f7c-4ab3-987e-1031e8c11033 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:29.433708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603158d5-7f7c-4ab3-987e-1031e8c11033 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:29.433848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603158d5-7f7c-4ab3-987e-1031e8c11033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:29.452189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-603158d5-7f7c-4ab3-987e-1031e8c11033 None None] MFA Rules not processed for user `ba5bb1004bdc4e74809cc8e43b5d9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:29.454087 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-603158d5-7f7c-4ab3-987e-1031e8c11033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:29.462632 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 706/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Wed May 25 13:43:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:29.476971 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b46ef3-18e7-4197-8cea-91e76b93b804 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:29.477263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b46ef3-18e7-4197-8cea-91e76b93b804 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:29.477541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b46ef3-18e7-4197-8cea-91e76b93b804 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:29.478942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 706/1412] 10.222.0.13 () {54 vars in 918 bytes} [Wed May 25 13:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:43:29.483550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363d86-f260-48d3-ba00-b74faa9daf54 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:29.483849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363d86-f260-48d3-ba00-b74faa9daf54 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:29.484137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363d86-f260-48d3-ba00-b74faa9daf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:29.502697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-c5363d86-f260-48d3-ba00-b74faa9daf54 None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:29.503913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-c5363d86-f260-48d3-ba00-b74faa9daf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:29.513666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 707/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Wed May 25 13:43:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:32.230654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235ec7-ca0f-48cf-be64-2b6ca7856c2e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:32.231229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235ec7-ca0f-48cf-be64-2b6ca7856c2e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:32.231354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235ec7-ca0f-48cf-be64-2b6ca7856c2e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:32.233119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:43:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:32.239328 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3d582-3654-4ac1-898c-193ca5fd1f65 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:32.239328 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3d582-3654-4ac1-898c-193ca5fd1f65 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:32.240026 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3d582-3654-4ac1-898c-193ca5fd1f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:32.257474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9cf3d582-3654-4ac1-898c-193ca5fd1f65 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:32.258729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9cf3d582-3654-4ac1-898c-193ca5fd1f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:32.267401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:32.311493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235ec7-ca0f-48cf-be64-2b6ca7856c2e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:32.326882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235ec7-ca0f-48cf-be64-2b6ca7856c2e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:32.333341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080714e1-61df-4612-9328-7df730b12566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:32.334027 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080714e1-61df-4612-9328-7df730b12566 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:32.334314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080714e1-61df-4612-9328-7df730b12566 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:32.334595 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080714e1-61df-4612-9328-7df730b12566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:32.343535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080714e1-61df-4612-9328-7df730b12566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:32.345151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080714e1-61df-4612-9328-7df730b12566 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:32.354742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 708/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:33.336826 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ba9c0-569e-43fd-b090-6da2c007c08d None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:33.337351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ba9c0-569e-43fd-b090-6da2c007c08d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:33.337351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ba9c0-569e-43fd-b090-6da2c007c08d None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:33.339050 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:33.344545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07bf4-4000-4d41-9339-4b1e0815ba24 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:33.344990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07bf4-4000-4d41-9339-4b1e0815ba24 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:33.345093 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07bf4-4000-4d41-9339-4b1e0815ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:33.363413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-0eb07bf4-4000-4d41-9339-4b1e0815ba24 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:33.364624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-0eb07bf4-4000-4d41-9339-4b1e0815ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:33.372767 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:33.535877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ba9c0-569e-43fd-b090-6da2c007c08d None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:33.550198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ba9c0-569e-43fd-b090-6da2c007c08d None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:33.555536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba7878-90d0-400a-901b-c14550533d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:33.556176 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba7878-90d0-400a-901b-c14550533d24 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:33.556464 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba7878-90d0-400a-901b-c14550533d24 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:33.556745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba7878-90d0-400a-901b-c14550533d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:33.564937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba7878-90d0-400a-901b-c14550533d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:33.566554 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba7878-90d0-400a-901b-c14550533d24 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:33.575849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 710/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:34.498831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135062-b85b-42da-b2f3-85c8f8aa8130 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:34.499349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135062-b85b-42da-b2f3-85c8f8aa8130 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:34.499349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135062-b85b-42da-b2f3-85c8f8aa8130 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:34.501224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:34.506199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be61d-6e8a-402f-84df-3849e7bd9408 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:34.506653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be61d-6e8a-402f-84df-3849e7bd9408 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:34.506761 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be61d-6e8a-402f-84df-3849e7bd9408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:34.524905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-197be61d-6e8a-402f-84df-3849e7bd9408 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:34.526275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-197be61d-6e8a-402f-84df-3849e7bd9408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:34.534844 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:34.686722 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a135062-b85b-42da-b2f3-85c8f8aa8130 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:34.701177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a135062-b85b-42da-b2f3-85c8f8aa8130 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:34.706591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef48e-f0e2-45f5-acc4-2a63d587d0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:34.707235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef48e-f0e2-45f5-acc4-2a63d587d0a7 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:34.707521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef48e-f0e2-45f5-acc4-2a63d587d0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:34.707797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef48e-f0e2-45f5-acc4-2a63d587d0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:34.716379 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aef48e-f0e2-45f5-acc4-2a63d587d0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:34.718000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aef48e-f0e2-45f5-acc4-2a63d587d0a7 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:34.727889 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 711/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:35.633225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772e5b-eb44-490f-8e97-f4ccc1775d8a None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:35.633872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772e5b-eb44-490f-8e97-f4ccc1775d8a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:35.633872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772e5b-eb44-490f-8e97-f4ccc1775d8a None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:35.635247 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:43:35.641718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982faeb7-566e-408d-8668-ee23aac20c8d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:35.642300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982faeb7-566e-408d-8668-ee23aac20c8d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:35.642405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982faeb7-566e-408d-8668-ee23aac20c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:35.661071 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-982faeb7-566e-408d-8668-ee23aac20c8d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:35.662332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-982faeb7-566e-408d-8668-ee23aac20c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:35.670543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:35.820766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772e5b-eb44-490f-8e97-f4ccc1775d8a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:35.836012 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772e5b-eb44-490f-8e97-f4ccc1775d8a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:35.842096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89299f-fefc-4741-be2b-46dcc11ced98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:35.842778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89299f-fefc-4741-be2b-46dcc11ced98 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:35.843072 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89299f-fefc-4741-be2b-46dcc11ced98 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:35.843357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89299f-fefc-4741-be2b-46dcc11ced98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:35.852751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89299f-fefc-4741-be2b-46dcc11ced98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:35.854452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89299f-fefc-4741-be2b-46dcc11ced98 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:35.865850 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 713/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:36.783533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b1d7f-7cfe-4ffc-a7a7-77af174a944e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:36.784097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b1d7f-7cfe-4ffc-a7a7-77af174a944e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:36.784097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b1d7f-7cfe-4ffc-a7a7-77af174a944e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:36.785491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:36.790710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b3164-2ccc-4469-a606-f30cad94f558 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:36.791153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b3164-2ccc-4469-a606-f30cad94f558 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:36.791395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b3164-2ccc-4469-a606-f30cad94f558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:36.809095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-fb1b3164-2ccc-4469-a606-f30cad94f558 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:36.810314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-fb1b3164-2ccc-4469-a606-f30cad94f558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:36.818398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:36.965724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b1d7f-7cfe-4ffc-a7a7-77af174a944e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:36.979977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b1d7f-7cfe-4ffc-a7a7-77af174a944e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:36.985466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac5ee0-f4f3-4ce2-b751-3ab06379a0ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:36.986125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5ee0-f4f3-4ce2-b751-3ab06379a0ac service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:36.986411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5ee0-f4f3-4ce2-b751-3ab06379a0ac service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:36.986688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5ee0-f4f3-4ce2-b751-3ab06379a0ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:36.994588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac5ee0-f4f3-4ce2-b751-3ab06379a0ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:36.996192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac5ee0-f4f3-4ce2-b751-3ab06379a0ac service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:37.007121 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 714/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:37.851155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755170a9-7ab1-4114-98d8-462d7c013d24 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:37.851663 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755170a9-7ab1-4114-98d8-462d7c013d24 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:37.851781 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755170a9-7ab1-4114-98d8-462d7c013d24 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:37.853113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:37.857959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c43f94-4efa-430b-9d5e-6e45f8cd908b None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:37.858402 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c43f94-4efa-430b-9d5e-6e45f8cd908b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:37.858527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c43f94-4efa-430b-9d5e-6e45f8cd908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:37.876957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-20c43f94-4efa-430b-9d5e-6e45f8cd908b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:37.878194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-20c43f94-4efa-430b-9d5e-6e45f8cd908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:37.886219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:38.035081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755170a9-7ab1-4114-98d8-462d7c013d24 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:38.049394 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755170a9-7ab1-4114-98d8-462d7c013d24 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:38.054644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442115c2-9f84-40c6-aa14-7d635e708885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:38.055272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442115c2-9f84-40c6-aa14-7d635e708885 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:38.055558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442115c2-9f84-40c6-aa14-7d635e708885 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:38.055834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442115c2-9f84-40c6-aa14-7d635e708885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:38.063683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442115c2-9f84-40c6-aa14-7d635e708885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:38.065256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442115c2-9f84-40c6-aa14-7d635e708885 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:38.074334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 716/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:38.929989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b82eb-58b0-4472-94e5-0b29e0a017f9 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:38.930531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b82eb-58b0-4472-94e5-0b29e0a017f9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:38.930953 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b82eb-58b0-4472-94e5-0b29e0a017f9 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:38.933096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:43:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:38.938877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a7f23-8e34-4c91-8db0-07392ce122c8 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:38.939393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a7f23-8e34-4c91-8db0-07392ce122c8 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:38.939499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a7f23-8e34-4c91-8db0-07392ce122c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:38.957921 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-c16a7f23-8e34-4c91-8db0-07392ce122c8 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:38.959163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-c16a7f23-8e34-4c91-8db0-07392ce122c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:38.967405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:39.118884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b82eb-58b0-4472-94e5-0b29e0a017f9 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:39.134543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b82eb-58b0-4472-94e5-0b29e0a017f9 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:39.140064 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f333b93-2872-4fd4-8f38-c7d46b11d314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:39.140823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f333b93-2872-4fd4-8f38-c7d46b11d314 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:39.141109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f333b93-2872-4fd4-8f38-c7d46b11d314 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:39.141391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f333b93-2872-4fd4-8f38-c7d46b11d314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:39.150695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f333b93-2872-4fd4-8f38-c7d46b11d314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:39.152310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f333b93-2872-4fd4-8f38-c7d46b11d314 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:39.164693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 717/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:43:40.039309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170a1ce-13b2-4489-868d-fd325c2f6e8b None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:40.039902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170a1ce-13b2-4489-868d-fd325c2f6e8b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:40.039902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170a1ce-13b2-4489-868d-fd325c2f6e8b None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:40.041417 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:40.048529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66a00-2800-46a1-912f-9dbb541a6029 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:40.049021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66a00-2800-46a1-912f-9dbb541a6029 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:40.049493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66a00-2800-46a1-912f-9dbb541a6029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:40.072642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-23b66a00-2800-46a1-912f-9dbb541a6029 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:40.073888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-23b66a00-2800-46a1-912f-9dbb541a6029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:40.086481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:40.249337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170a1ce-13b2-4489-868d-fd325c2f6e8b None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:40.265128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170a1ce-13b2-4489-868d-fd325c2f6e8b None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:40.271297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51033a48-414b-42c2-a4d2-71de26ac27f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:40.271996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51033a48-414b-42c2-a4d2-71de26ac27f1 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:40.272281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51033a48-414b-42c2-a4d2-71de26ac27f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:40.272564 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51033a48-414b-42c2-a4d2-71de26ac27f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:40.284661 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51033a48-414b-42c2-a4d2-71de26ac27f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:40.287720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51033a48-414b-42c2-a4d2-71de26ac27f1 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:40.305723 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 719/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:41.194316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b6c9-bc30-40b2-98d5-04e4bf6ba290 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:41.195164 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b6c9-bc30-40b2-98d5-04e4bf6ba290 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:41.195164 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b6c9-bc30-40b2-98d5-04e4bf6ba290 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:41.196700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:43:41.203528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6d56-4bc7-4c76-b82a-997798798a2a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:41.204160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6d56-4bc7-4c76-b82a-997798798a2a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:41.204160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6d56-4bc7-4c76-b82a-997798798a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:41.226206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b65d6d56-4bc7-4c76-b82a-997798798a2a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:41.227514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b65d6d56-4bc7-4c76-b82a-997798798a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:41.236367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:41.388341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4b6c9-bc30-40b2-98d5-04e4bf6ba290 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:41.403502 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4b6c9-bc30-40b2-98d5-04e4bf6ba290 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:41.409772 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75687013-99fe-4be5-91dd-7869816aa859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:41.410438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687013-99fe-4be5-91dd-7869816aa859 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:41.410729 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687013-99fe-4be5-91dd-7869816aa859 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:41.411043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687013-99fe-4be5-91dd-7869816aa859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:41.420154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75687013-99fe-4be5-91dd-7869816aa859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:41.421870 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75687013-99fe-4be5-91dd-7869816aa859 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:41.437719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 720/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:43.690784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ede3-92a1-45a9-bbc3-9122cc33e964 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:43.691386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ede3-92a1-45a9-bbc3-9122cc33e964 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:43.691655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ede3-92a1-45a9-bbc3-9122cc33e964 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:43.693335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:43.699258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c852-1063-4138-855f-57663d65cb60 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:43.699747 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c852-1063-4138-855f-57663d65cb60 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:43.699898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c852-1063-4138-855f-57663d65cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:43.725757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b4b6c852-1063-4138-855f-57663d65cb60 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:43.727002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b4b6c852-1063-4138-855f-57663d65cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:43.736848 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:43.781905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289ede3-92a1-45a9-bbc3-9122cc33e964 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:43.794211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289ede3-92a1-45a9-bbc3-9122cc33e964 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:43.798631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb8259-7609-486a-b2cc-1dfd6920dba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:43.799463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb8259-7609-486a-b2cc-1dfd6920dba6 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:43.799836 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb8259-7609-486a-b2cc-1dfd6920dba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:43.800391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb8259-7609-486a-b2cc-1dfd6920dba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:43.811409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb8259-7609-486a-b2cc-1dfd6920dba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:43.813609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb8259-7609-486a-b2cc-1dfd6920dba6 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:43.826892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 722/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:46.406167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a446-3d43-4467-a1ec-d854250982f9 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:46.407365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a446-3d43-4467-a1ec-d854250982f9 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:46.407365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a446-3d43-4467-a1ec-d854250982f9 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:46.408958 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:46.416613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0468ebc-4e6d-4c53-855f-6610361293e7 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:46.417519 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0468ebc-4e6d-4c53-855f-6610361293e7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:46.417700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0468ebc-4e6d-4c53-855f-6610361293e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:46.440254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-a0468ebc-4e6d-4c53-855f-6610361293e7 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:46.441932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-a0468ebc-4e6d-4c53-855f-6610361293e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:46.451601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:46.519528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0a446-3d43-4467-a1ec-d854250982f9 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:46.533213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0a446-3d43-4467-a1ec-d854250982f9 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:46.537530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2fa6-0a46-4d66-a7da-6e4764f0c6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:46.538266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2fa6-0a46-4d66-a7da-6e4764f0c6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:46.538624 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2fa6-0a46-4d66-a7da-6e4764f0c6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:46.538927 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2fa6-0a46-4d66-a7da-6e4764f0c6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:46.550257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b2fa6-0a46-4d66-a7da-6e4764f0c6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:46.551850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b2fa6-0a46-4d66-a7da-6e4764f0c6b7 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:46.564905 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 723/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:49.419104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0724f0-c9cd-4d8a-bfa8-e3e40bf23804 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:49.419676 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0724f0-c9cd-4d8a-bfa8-e3e40bf23804 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:49.419676 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0724f0-c9cd-4d8a-bfa8-e3e40bf23804 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:49.420990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:49.427032 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605336b9-f2ac-479b-833d-fb57fce03125 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:49.427571 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605336b9-f2ac-479b-833d-fb57fce03125 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:49.427676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605336b9-f2ac-479b-833d-fb57fce03125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:49.450606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-605336b9-f2ac-479b-833d-fb57fce03125 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:49.452052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-605336b9-f2ac-479b-833d-fb57fce03125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:49.460697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:43:49.503183 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0724f0-c9cd-4d8a-bfa8-e3e40bf23804 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:49.515104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0724f0-c9cd-4d8a-bfa8-e3e40bf23804 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:49.519423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e629e2-32ea-4ceb-b48b-873301dd8c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:49.520138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e629e2-32ea-4ceb-b48b-873301dd8c6b service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:49.520431 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e629e2-32ea-4ceb-b48b-873301dd8c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:49.520714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e629e2-32ea-4ceb-b48b-873301dd8c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:49.531642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e629e2-32ea-4ceb-b48b-873301dd8c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:49.533265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e629e2-32ea-4ceb-b48b-873301dd8c6b service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:49.543729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 725/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:52.143683 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24d25-8ce1-4bd6-8229-e6f9e6abbb30 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:52.144257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24d25-8ce1-4bd6-8229-e6f9e6abbb30 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:52.144257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24d25-8ce1-4bd6-8229-e6f9e6abbb30 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:52.145712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:43:52.151743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8b18-4ffa-45dd-8568-9e6a439eaa70 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:52.152465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8b18-4ffa-45dd-8568-9e6a439eaa70 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:52.152465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8b18-4ffa-45dd-8568-9e6a439eaa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:52.174068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-abfd8b18-4ffa-45dd-8568-9e6a439eaa70 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:52.175401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-abfd8b18-4ffa-45dd-8568-9e6a439eaa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:52.184198 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:52.226225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b24d25-8ce1-4bd6-8229-e6f9e6abbb30 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:52.237830 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b24d25-8ce1-4bd6-8229-e6f9e6abbb30 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:52.241505 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8118bf-8caf-4d73-a1d7-871be2d67adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:52.242194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8118bf-8caf-4d73-a1d7-871be2d67adf service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:52.242482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8118bf-8caf-4d73-a1d7-871be2d67adf service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:52.242841 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8118bf-8caf-4d73-a1d7-871be2d67adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:52.253362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8118bf-8caf-4d73-a1d7-871be2d67adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:52.255035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8118bf-8caf-4d73-a1d7-871be2d67adf service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:52.266644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 726/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:54.663315 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74f35-6ec2-48d7-ae78-d348b2e3b793 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:54.663860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74f35-6ec2-48d7-ae78-d348b2e3b793 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:54.663978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74f35-6ec2-48d7-ae78-d348b2e3b793 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:54.665293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:54.671371 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed507d0-0328-4130-8a3a-60b9a3e0fd93 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:54.672393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed507d0-0328-4130-8a3a-60b9a3e0fd93 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:54.672507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed507d0-0328-4130-8a3a-60b9a3e0fd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:54.691390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-1ed507d0-0328-4130-8a3a-60b9a3e0fd93 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:54.692622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1ed507d0-0328-4130-8a3a-60b9a3e0fd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:54.701030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:54.748753 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74f35-6ec2-48d7-ae78-d348b2e3b793 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:54.765968 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74f35-6ec2-48d7-ae78-d348b2e3b793 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:54.771830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14a743-7ac7-4369-929a-36a522a1bfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:54.773072 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a743-7ac7-4369-929a-36a522a1bfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:54.773570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a743-7ac7-4369-929a-36a522a1bfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:54.774093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a743-7ac7-4369-929a-36a522a1bfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:54.794600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14a743-7ac7-4369-929a-36a522a1bfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:54.798316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14a743-7ac7-4369-929a-36a522a1bfa3 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:54.814819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 728/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:57.235705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae4b-e4fa-445a-93b4-78eeee4767d0 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:57.236297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae4b-e4fa-445a-93b4-78eeee4767d0 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:57.236297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae4b-e4fa-445a-93b4-78eeee4767d0 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:57.237655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:57.244705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7f1f-9b61-4464-9a2f-682229367d7d None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:57.245255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7f1f-9b61-4464-9a2f-682229367d7d None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:57.245255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7f1f-9b61-4464-9a2f-682229367d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:57.264726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-061e7f1f-9b61-4464-9a2f-682229367d7d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:57.266559 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-061e7f1f-9b61-4464-9a2f-682229367d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:57.274914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:57.321371 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4ae4b-e4fa-445a-93b4-78eeee4767d0 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:57.334561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4ae4b-e4fa-445a-93b4-78eeee4767d0 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:57.339380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece10a5-77fe-4e63-8896-16a29cc20473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:57.340320 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece10a5-77fe-4e63-8896-16a29cc20473 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:57.340616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece10a5-77fe-4e63-8896-16a29cc20473 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:57.340990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece10a5-77fe-4e63-8896-16a29cc20473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:57.355689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece10a5-77fe-4e63-8896-16a29cc20473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:57.357279 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece10a5-77fe-4e63-8896-16a29cc20473 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:57.369035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 729/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:43:59.777910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c9c8-3f78-47a3-b6ab-24abfbd742a8 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:59.778520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c9c8-3f78-47a3-b6ab-24abfbd742a8 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:59.778520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c9c8-3f78-47a3-b6ab-24abfbd742a8 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:59.780001 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:43:59.786778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05ff9-98a5-4ff4-af2d-c87e5e1f3352 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:59.787320 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05ff9-98a5-4ff4-af2d-c87e5e1f3352 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:59.787320 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05ff9-98a5-4ff4-af2d-c87e5e1f3352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:59.794783 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=70 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:59.809161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-2cb05ff9-98a5-4ff4-af2d-c87e5e1f3352 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:43:59.810641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-2cb05ff9-98a5-4ff4-af2d-c87e5e1f3352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:43:59.820000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:43:59.861967 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c9c8-3f78-47a3-b6ab-24abfbd742a8 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:43:59.867543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=73 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:43:59.876884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c9c8-3f78-47a3-b6ab-24abfbd742a8 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:43:59.880535 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1525d14-04b5-4b1a-b1a1-fe7dd9c602e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:43:59.881199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1525d14-04b5-4b1a-b1a1-fe7dd9c602e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:43:59.881481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1525d14-04b5-4b1a-b1a1-fe7dd9c602e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:43:59.881860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1525d14-04b5-4b1a-b1a1-fe7dd9c602e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:43:59.892430 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1525d14-04b5-4b1a-b1a1-fe7dd9c602e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:43:59.893906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1525d14-04b5-4b1a-b1a1-fe7dd9c602e4 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:43:59.903543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 731/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:02.442950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06e35-0f85-4c2a-8f9b-d13288a3ab1e None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:02.443555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06e35-0f85-4c2a-8f9b-d13288a3ab1e None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:02.443555 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06e35-0f85-4c2a-8f9b-d13288a3ab1e None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:02.444895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:02.451543 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba0949-1837-4b06-ba9a-531846883517 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:02.452211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba0949-1837-4b06-ba9a-531846883517 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:02.452718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba0949-1837-4b06-ba9a-531846883517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:02.474060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9aba0949-1837-4b06-ba9a-531846883517 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:02.475378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9aba0949-1837-4b06-ba9a-531846883517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:02.484792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:02.533621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d06e35-0f85-4c2a-8f9b-d13288a3ab1e None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:02.544499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d06e35-0f85-4c2a-8f9b-d13288a3ab1e None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:02.548660 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202aef15-4e89-459a-93e0-6131ff21a335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:02.549302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aef15-4e89-459a-93e0-6131ff21a335 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:02.549587 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aef15-4e89-459a-93e0-6131ff21a335 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:02.549891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aef15-4e89-459a-93e0-6131ff21a335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:02.559452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202aef15-4e89-459a-93e0-6131ff21a335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:02.560847 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202aef15-4e89-459a-93e0-6131ff21a335 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:02.571008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 732/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:05.014901 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59faa-a9e0-41ee-8711-88c108fc93d7 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:05.015470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59faa-a9e0-41ee-8711-88c108fc93d7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:05.015470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59faa-a9e0-41ee-8711-88c108fc93d7 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:05.016902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:05.022883 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3d2b-a705-4ae2-9402-9ddca46d39f7 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:05.023436 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3d2b-a705-4ae2-9402-9ddca46d39f7 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:05.023436 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3d2b-a705-4ae2-9402-9ddca46d39f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:05.041507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-727d3d2b-a705-4ae2-9402-9ddca46d39f7 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:05.042754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-727d3d2b-a705-4ae2-9402-9ddca46d39f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:05.051293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:05.087882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59faa-a9e0-41ee-8711-88c108fc93d7 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:05.105386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59faa-a9e0-41ee-8711-88c108fc93d7 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:05.110239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272e568-e0f7-4e33-8fb4-cabba48482d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:05.110881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e568-e0f7-4e33-8fb4-cabba48482d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:05.111166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e568-e0f7-4e33-8fb4-cabba48482d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:05.111443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e568-e0f7-4e33-8fb4-cabba48482d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:05.122016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272e568-e0f7-4e33-8fb4-cabba48482d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:05.123749 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272e568-e0f7-4e33-8fb4-cabba48482d6 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:05.135774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 734/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:07.397136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184571d6-3072-4ce7-b221-5805779ada74 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:07.397666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184571d6-3072-4ce7-b221-5805779ada74 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:07.397666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184571d6-3072-4ce7-b221-5805779ada74 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:07.399073 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:07.404443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9bd2-209c-498f-a01a-755425171682 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:07.404842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9bd2-209c-498f-a01a-755425171682 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:07.404999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9bd2-209c-498f-a01a-755425171682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:07.423095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-461e9bd2-209c-498f-a01a-755425171682 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:07.424285 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-461e9bd2-209c-498f-a01a-755425171682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:07.431948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:07.467592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184571d6-3072-4ce7-b221-5805779ada74 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:07.479033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184571d6-3072-4ce7-b221-5805779ada74 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:07.482607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057208b-66b0-4fdd-a869-53cbbc5d36cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:07.483251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057208b-66b0-4fdd-a869-53cbbc5d36cb service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:07.483540 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057208b-66b0-4fdd-a869-53cbbc5d36cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:07.483822 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057208b-66b0-4fdd-a869-53cbbc5d36cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:07.492651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057208b-66b0-4fdd-a869-53cbbc5d36cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:07.494138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057208b-66b0-4fdd-a869-53cbbc5d36cb service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:07.503528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 735/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:17.418043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=17 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:17.499341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=17 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:44:41.911193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3015d5-0862-47b2-a80e-354e37359486 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.911824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3015d5-0862-47b2-a80e-354e37359486 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.911824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3015d5-0862-47b2-a80e-354e37359486 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.913218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 736/1471] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:41.918590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d36a-ffb0-4603-84ee-7b28009c5882 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.919047 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d36a-ffb0-4603-84ee-7b28009c5882 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.919146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d36a-ffb0-4603-84ee-7b28009c5882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.937033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-ce88d36a-ffb0-4603-84ee-7b28009c5882 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:41.938294 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ce88d36a-ffb0-4603-84ee-7b28009c5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:41.946017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 736/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:41.993913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924ec2-5aa9-43ba-b9eb-7ff52cb162fc None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:41.996640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924ec2-5aa9-43ba-b9eb-7ff52cb162fc None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:41.996640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924ec2-5aa9-43ba-b9eb-7ff52cb162fc None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:41.996640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 737/1473] 10.222.0.13 () {54 vars in 962 bytes} [Wed May 25 13:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:42.001000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57ff0-6f04-49c0-8f31-5039c2e98ccc None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:42.001319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57ff0-6f04-49c0-8f31-5039c2e98ccc None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:42.001600 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57ff0-6f04-49c0-8f31-5039c2e98ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:42.019902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-22f57ff0-6f04-49c0-8f31-5039c2e98ccc None None] MFA Rules not processed for user `7fc89b93f03e453da2780d75216e0566`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:42.021106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-22f57ff0-6f04-49c0-8f31-5039c2e98ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:42.028188 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 737/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Wed May 25 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:42.036342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924ec2-5aa9-43ba-b9eb-7ff52cb162fc None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:42.046930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924ec2-5aa9-43ba-b9eb-7ff52cb162fc None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:42.050399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08064b23-5f7a-4ba0-9f20-dcc71a696753 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc89b93f03e453da2780d75216e0566', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:42.051029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064b23-5f7a-4ba0-9f20-dcc71a696753 service glance] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:42.051311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064b23-5f7a-4ba0-9f20-dcc71a696753 service glance] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:42.051586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064b23-5f7a-4ba0-9f20-dcc71a696753 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:42.060330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08064b23-5f7a-4ba0-9f20-dcc71a696753 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:42.062311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08064b23-5f7a-4ba0-9f20-dcc71a696753 service glance] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:42.071558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 738/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:44.433017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a189d-7011-4b27-89d3-9ec700ff7727 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:44.433684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a189d-7011-4b27-89d3-9ec700ff7727 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:44.433684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a189d-7011-4b27-89d3-9ec700ff7727 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:44.435037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 738/1476] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:44.440939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e77e39-5639-47ce-b307-dd0dba888c07 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:44.441465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e77e39-5639-47ce-b307-dd0dba888c07 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:44.441575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e77e39-5639-47ce-b307-dd0dba888c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:44.461283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-15e77e39-5639-47ce-b307-dd0dba888c07 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:44.462536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-15e77e39-5639-47ce-b307-dd0dba888c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:44.470647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 739/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:44.493955 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a189d-7011-4b27-89d3-9ec700ff7727 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:44.507124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a189d-7011-4b27-89d3-9ec700ff7727 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:44.511590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade36cab-6a36-4978-964b-2e7b6fa48e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:44.512243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36cab-6a36-4978-964b-2e7b6fa48e8d admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:44.512533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36cab-6a36-4978-964b-2e7b6fa48e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:44.512815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36cab-6a36-4978-964b-2e7b6fa48e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:44.513553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade36cab-6a36-4978-964b-2e7b6fa48e8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:44.516021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING py.warnings [None req-ade36cab-6a36-4978-964b-2e7b6fa48e8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:44:44.516021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: warnings.warn(msg) May 25 13:44:44.516021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: May 25 13:44:44.517187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade36cab-6a36-4978-964b-2e7b6fa48e8d admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:44.537888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 739/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Wed May 25 13:44:44 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:44:46.790674 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bcc1-bab8-4109-b2a1-3e8c65e97906 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:46.791481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bcc1-bab8-4109-b2a1-3e8c65e97906 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:46.791481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bcc1-bab8-4109-b2a1-3e8c65e97906 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:46.792859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 740/1479] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:46.798830 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ee1a5-6c12-4087-ba10-5c090889ecb1 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:46.799494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ee1a5-6c12-4087-ba10-5c090889ecb1 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:46.799494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ee1a5-6c12-4087-ba10-5c090889ecb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:46.818676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b14ee1a5-6c12-4087-ba10-5c090889ecb1 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:46.819886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b14ee1a5-6c12-4087-ba10-5c090889ecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:46.829554 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 740/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:46.874693 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4bcc1-bab8-4109-b2a1-3e8c65e97906 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:46.890415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4bcc1-bab8-4109-b2a1-3e8c65e97906 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:46.896243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b769bc-9998-4cbe-b0ab-d361a791f4e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:46.896927 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b769bc-9998-4cbe-b0ab-d361a791f4e8 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:46.897218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b769bc-9998-4cbe-b0ab-d361a791f4e8 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:46.897500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b769bc-9998-4cbe-b0ab-d361a791f4e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:46.906879 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b769bc-9998-4cbe-b0ab-d361a791f4e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:46.908523 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b769bc-9998-4cbe-b0ab-d361a791f4e8 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:46.919123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 741/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:49.366026 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db32b4-2beb-4928-80c9-b11bb445e869 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:49.366613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db32b4-2beb-4928-80c9-b11bb445e869 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:49.366613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db32b4-2beb-4928-80c9-b11bb445e869 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:49.367991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 741/1482] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:49.374211 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9842f3-eba2-4cd4-b1d1-f5a287babebb None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:49.374715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9842f3-eba2-4cd4-b1d1-f5a287babebb None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:49.374715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9842f3-eba2-4cd4-b1d1-f5a287babebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:49.392688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-ee9842f3-eba2-4cd4-b1d1-f5a287babebb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:49.393944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-ee9842f3-eba2-4cd4-b1d1-f5a287babebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:49.401787 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 742/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:49.439372 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db32b4-2beb-4928-80c9-b11bb445e869 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:49.451241 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db32b4-2beb-4928-80c9-b11bb445e869 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:49.454804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51855ed-77b9-4fd0-9e98-9b1b214f3e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:49.455456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51855ed-77b9-4fd0-9e98-9b1b214f3e89 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:49.455739 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51855ed-77b9-4fd0-9e98-9b1b214f3e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:49.456015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51855ed-77b9-4fd0-9e98-9b1b214f3e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:49.468712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51855ed-77b9-4fd0-9e98-9b1b214f3e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:49.470223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51855ed-77b9-4fd0-9e98-9b1b214f3e89 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:49.480297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 742/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:51.805563 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1783-9d8f-4f5a-ade4-d1f8e10d8fd6 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:51.806258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1783-9d8f-4f5a-ade4-d1f8e10d8fd6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:51.806258 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1783-9d8f-4f5a-ade4-d1f8e10d8fd6 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:51.807807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 743/1485] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:51.814353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06fa37-45cb-476a-8935-d7e41716eedf None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:51.814929 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06fa37-45cb-476a-8935-d7e41716eedf None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:51.815097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06fa37-45cb-476a-8935-d7e41716eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:51.835909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-cc06fa37-45cb-476a-8935-d7e41716eedf None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:51.837115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-cc06fa37-45cb-476a-8935-d7e41716eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:51.845639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 743/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:51.883682 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba1783-9d8f-4f5a-ade4-d1f8e10d8fd6 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:51.895284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba1783-9d8f-4f5a-ade4-d1f8e10d8fd6 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:51.899380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f555919-19a7-448d-acc6-e97ecf373584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:51.900132 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f555919-19a7-448d-acc6-e97ecf373584 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:51.900461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f555919-19a7-448d-acc6-e97ecf373584 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:51.900803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f555919-19a7-448d-acc6-e97ecf373584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:51.911256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f555919-19a7-448d-acc6-e97ecf373584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:51.912706 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f555919-19a7-448d-acc6-e97ecf373584 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:51.923487 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 744/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:54.297088 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71044c-f856-49ac-9a7c-f0f76f1d764a None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:54.297721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71044c-f856-49ac-9a7c-f0f76f1d764a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:54.297721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71044c-f856-49ac-9a7c-f0f76f1d764a None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:54.299085 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 744/1488] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:54.304625 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5600e8-f64b-4f8b-a497-1d8f3827f56b None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:54.305106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5600e8-f64b-4f8b-a497-1d8f3827f56b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:54.305227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5600e8-f64b-4f8b-a497-1d8f3827f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:54.322906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-6f5600e8-f64b-4f8b-a497-1d8f3827f56b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:54.324116 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-6f5600e8-f64b-4f8b-a497-1d8f3827f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:54.331973 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 745/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:54.375464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71044c-f856-49ac-9a7c-f0f76f1d764a None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:54.386304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71044c-f856-49ac-9a7c-f0f76f1d764a None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:54.390310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41513e65-a3ce-4f43-9ca7-f7c231935531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:54.390951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513e65-a3ce-4f43-9ca7-f7c231935531 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:54.391229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513e65-a3ce-4f43-9ca7-f7c231935531 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:54.391504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513e65-a3ce-4f43-9ca7-f7c231935531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:54.400708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41513e65-a3ce-4f43-9ca7-f7c231935531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:54.402184 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41513e65-a3ce-4f43-9ca7-f7c231935531 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:54.412364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 745/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:44:56.881634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dbd67-b47f-4ee9-9f4b-a7eb37daa569 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:56.882508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dbd67-b47f-4ee9-9f4b-a7eb37daa569 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:56.882669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dbd67-b47f-4ee9-9f4b-a7eb37daa569 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:56.884301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 746/1491] 10.222.0.13 () {54 vars in 926 bytes} [Wed May 25 13:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:44:56.890096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4cd9b-1eb4-43b1-a4b9-91d6075ef211 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:56.890534 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4cd9b-1eb4-43b1-a4b9-91d6075ef211 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:56.890643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4cd9b-1eb4-43b1-a4b9-91d6075ef211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:56.908833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-36b4cd9b-1eb4-43b1-a4b9-91d6075ef211 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:44:56.910137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-36b4cd9b-1eb4-43b1-a4b9-91d6075ef211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:44:56.918343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 746/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Wed May 25 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:44:56.958147 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dbd67-b47f-4ee9-9f4b-a7eb37daa569 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:44:56.970411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dbd67-b47f-4ee9-9f4b-a7eb37daa569 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:44:56.974071 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670030-93e8-4996-a613-9f97525f4a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:44:56.974726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670030-93e8-4996-a613-9f97525f4a0e service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:44:56.975010 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670030-93e8-4996-a613-9f97525f4a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:44:56.975287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670030-93e8-4996-a613-9f97525f4a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:44:56.985461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db670030-93e8-4996-a613-9f97525f4a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:44:56.986986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db670030-93e8-4996-a613-9f97525f4a0e service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:44:56.997316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 747/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:45:06.903154 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=33 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:45:06.992587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=33 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:45.646863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636895f-bb75-438b-9453-09e70cfc9cd0 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:45.647437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636895f-bb75-438b-9453-09e70cfc9cd0 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:45.647437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636895f-bb75-438b-9453-09e70cfc9cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:45.667458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-c636895f-bb75-438b-9453-09e70cfc9cd0 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:45.668831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-c636895f-bb75-438b-9453-09e70cfc9cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:45.677058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 747/1494] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:45.687494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fbef-d5b3-4b12-a9dd-adde7a8b9d9c None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:45.688107 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fbef-d5b3-4b12-a9dd-adde7a8b9d9c None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:45.688107 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fbef-d5b3-4b12-a9dd-adde7a8b9d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:45.710018 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-7984fbef-d5b3-4b12-a9dd-adde7a8b9d9c None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:45.711356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-7984fbef-d5b3-4b12-a9dd-adde7a8b9d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:45.720745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 748/1495] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:45.726062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636895f-bb75-438b-9453-09e70cfc9cd0 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:45.739904 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636895f-bb75-438b-9453-09e70cfc9cd0 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:45.746896 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:45.747999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:45.748494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:45.748992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:45.750287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:46:45.750717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:45.752457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING py.warnings [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 13:46:45.752457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: warnings.warn(msg) May 25 13:46:45.752457 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: May 25 13:46:45.754032 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:45.774220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 748/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:46:45.783667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984fbef-d5b3-4b12-a9dd-adde7a8b9d9c None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:45.794296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984fbef-d5b3-4b12-a9dd-adde7a8b9d9c None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:45.799373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:45.800221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:45.800531 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:45.800833 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:45.801583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:45.803551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING py.warnings [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:46:45.803551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: warnings.warn(msg) May 25 13:46:45.803551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: May 25 13:46:45.804913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:45.844033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 749/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:46:45 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:46:45.848324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:45.859132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749cbaf-85f5-48c0-9557-593ea18bf0bf admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:45.920705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:45.921669 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:45.922113 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:45.922578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:45.923652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:45.925403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING py.warnings [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:46:45.925403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: warnings.warn(msg) May 25 13:46:45.925403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: May 25 13:46:45.926983 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:45.952197 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 749/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:46:45 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:46:45.956413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:45.967344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69100b7-431e-4db6-943a-caac56fdd2ff admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:45.971988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:45.972667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:45.972961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:45.973245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:45.974018 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:45.975046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING py.warnings [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 13:46:45.975046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: warnings.warn(msg) May 25 13:46:45.975046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: May 25 13:46:45.975957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:45.989320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 750/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:46:45.993768 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:46.010076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e16118-bbc8-4686-aa89-f0742baa70f7 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:46.019435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5d0de-fbbb-4872-8bba-cba132087cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:46.020142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d0de-fbbb-4872-8bba-cba132087cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.020436 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d0de-fbbb-4872-8bba-cba132087cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.020722 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d0de-fbbb-4872-8bba-cba132087cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.021514 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5d0de-fbbb-4872-8bba-cba132087cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:46.022690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING py.warnings [None req-c7d5d0de-fbbb-4872-8bba-cba132087cd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 13:46:46.022690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: warnings.warn(msg) May 25 13:46:46.022690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: May 25 13:46:46.023602 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5d0de-fbbb-4872-8bba-cba132087cd4 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:46.037222 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 750/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:46:46.041892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:46.052221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddeea1-30e9-46ff-8ab4-5e478453d212 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:46.056897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37689e6f-98c5-4d6a-ab69-b00a72b6b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:46.057837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37689e6f-98c5-4d6a-ab69-b00a72b6b75f admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.058112 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37689e6f-98c5-4d6a-ab69-b00a72b6b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.058884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37689e6f-98c5-4d6a-ab69-b00a72b6b75f admin admin] PATH_INFO: `/v3/projects/81c90bd5a3c143b7b21a0354d71e4e59/users/52a0b28bded243e6b0479aef20bbe074/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.074780 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37689e6f-98c5-4d6a-ab69-b00a72b6b75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c90bd5a3c143b7b21a0354d71e4e59, user_id=52a0b28bded243e6b0479aef20bbe074, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:46.075825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING py.warnings [None req-37689e6f-98c5-4d6a-ab69-b00a72b6b75f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:46:46.075825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: warnings.warn(msg) May 25 13:46:46.075825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: May 25 13:46:46.077817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37689e6f-98c5-4d6a-ab69-b00a72b6b75f admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:46.092054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 751/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:46:46 2022] PUT /identity/v3/projects/81c90bd5a3c143b7b21a0354d71e4e59/users/52a0b28bded243e6b0479aef20bbe074/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:46:46.103613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8c4d-96ae-45f9-895e-0d9bf3cc3bad None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.103899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8c4d-96ae-45f9-895e-0d9bf3cc3bad None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.104186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8c4d-96ae-45f9-895e-0d9bf3cc3bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.132899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-63bb8c4d-96ae-45f9-895e-0d9bf3cc3bad None None] MFA Rules not processed for user `52a0b28bded243e6b0479aef20bbe074`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:46.134156 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-63bb8c4d-96ae-45f9-895e-0d9bf3cc3bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:46.199366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 751/1502] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:46:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:46:46.212605 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8b65-b767-40c6-b8df-98fff03c62fc None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.212903 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8b65-b767-40c6-b8df-98fff03c62fc None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.213200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8b65-b767-40c6-b8df-98fff03c62fc None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.214646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 752/1503] 10.222.0.13 () {54 vars in 963 bytes} [Wed May 25 13:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:46.220002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2c5d-3e5e-4c6e-8033-a8575a6b406a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.220297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2c5d-3e5e-4c6e-8033-a8575a6b406a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.220579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2c5d-3e5e-4c6e-8033-a8575a6b406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.239223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-3d3f2c5d-3e5e-4c6e-8033-a8575a6b406a None None] MFA Rules not processed for user `5c27e8bab1f3424aadd7ca66a1e2756f`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:46.240490 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-3d3f2c5d-3e5e-4c6e-8033-a8575a6b406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:46.287496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:46.296598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 752/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Wed May 25 13:46:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:46.409109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee8b65-b767-40c6-b8df-98fff03c62fc None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:46.420615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee8b65-b767-40c6-b8df-98fff03c62fc None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:46.424313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc381c0-ab7f-4d4b-a473-a24d647ae113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:46.424968 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc381c0-ab7f-4d4b-a473-a24d647ae113 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.425264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc381c0-ab7f-4d4b-a473-a24d647ae113 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.425553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc381c0-ab7f-4d4b-a473-a24d647ae113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.435239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc381c0-ab7f-4d4b-a473-a24d647ae113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:46.436710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc381c0-ab7f-4d4b-a473-a24d647ae113 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:46.446843 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 753/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:46:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:46.501426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1fb15-a9bf-4c38-95ae-ed8a63bfcf73 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.501725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1fb15-a9bf-4c38-95ae-ed8a63bfcf73 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.502056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1fb15-a9bf-4c38-95ae-ed8a63bfcf73 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.503405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 753/1506] 10.222.0.13 () {52 vars in 829 bytes} [Wed May 25 13:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:46:46.507340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc381c0-ab7f-4d4b-a473-a24d647ae113 service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:46.596518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc381c0-ab7f-4d4b-a473-a24d647ae113 service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:46.604002 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:46.605980 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.606497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.607017 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] PATH_INFO: `/v3/users/52a0b28bded243e6b0479aef20bbe074` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.609115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a0b28bded243e6b0479aef20bbe074)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:46.611003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING py.warnings [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:46:46.611003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: warnings.warn(msg) May 25 13:46:46.611003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: May 25 13:46:46.613300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:46.713326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a0b28bded243e6b0479aef20bbe074'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:46.725100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a0b28bded243e6b0479aef20bbe074'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:46.725769 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a0b28bded243e6b0479aef20bbe074'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:46.739273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a0b28bded243e6b0479aef20bbe074'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:46.755566 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:46.758502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a0b28bded243e6b0479aef20bbe074'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:46.766172 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 754/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:46:46 2022] DELETE /identity/v3/users/52a0b28bded243e6b0479aef20bbe074 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:46:46.770716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999dfb9-adaf-4ec8-b63a-b6847e0d4645 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.771187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999dfb9-adaf-4ec8-b63a-b6847e0d4645 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.771299 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999dfb9-adaf-4ec8-b63a-b6847e0d4645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.789637 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-a999dfb9-adaf-4ec8-b63a-b6847e0d4645 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:46:46.790966 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a999dfb9-adaf-4ec8-b63a-b6847e0d4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:46.862222 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 754/1508] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:46:46.873424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:46.875669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:46.943272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe02e8-2733-41f3-b748-93de3f8d95cc admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:46.947066 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308cf60-6e1a-4d5f-b530-cbabc47ded0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:46.947736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308cf60-6e1a-4d5f-b530-cbabc47ded0b service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:46.948031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308cf60-6e1a-4d5f-b530-cbabc47ded0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:46.948314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308cf60-6e1a-4d5f-b530-cbabc47ded0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:46.959115 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308cf60-6e1a-4d5f-b530-cbabc47ded0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:46.960572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308cf60-6e1a-4d5f-b530-cbabc47ded0b service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:46.971232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 755/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:46:47.300116 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999dfb9-adaf-4ec8-b63a-b6847e0d4645 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:46:47.302516 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a999dfb9-adaf-4ec8-b63a-b6847e0d4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:46:47.324787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999dfb9-adaf-4ec8-b63a-b6847e0d4645 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:46:47.331559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:46:47.332903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:46:47.333283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:46:47.333757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] PATH_INFO: `/v3/projects/81c90bd5a3c143b7b21a0354d71e4e59` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:46:47.336037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c90bd5a3c143b7b21a0354d71e4e59)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:46:47.337267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING py.warnings [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:46:47.337267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: warnings.warn(msg) May 25 13:46:47.337267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: May 25 13:46:47.338646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:46:47.416367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c90bd5a3c143b7b21a0354d71e4e59', 'request_id': 'req-a6a55eaf-8910-432d-bf2c-6d6faa724412'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:47.432903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c90bd5a3c143b7b21a0354d71e4e59', 'request_id': 'req-a6a55eaf-8910-432d-bf2c-6d6faa724412'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:47.441911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c90bd5a3c143b7b21a0354d71e4e59', 'request_id': 'req-a6a55eaf-8910-432d-bf2c-6d6faa724412'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:47.460165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] The token cache is being invalidate because project 81c90bd5a3c143b7b21a0354d71e4e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:46:47.460522 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:47.461275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-a6a55eaf-8910-432d-bf2c-6d6faa724412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:46:47.463278 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 755/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:46:47 2022] DELETE /identity/v3/projects/81c90bd5a3c143b7b21a0354d71e4e59 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:46:56.966896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:46:57.456191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:48:28.946610 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258330f-bf41-42f5-a1ac-dc446643c11c None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:28.947239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258330f-bf41-42f5-a1ac-dc446643c11c None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:28.947239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258330f-bf41-42f5-a1ac-dc446643c11c None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:28.949085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:28.954043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6953dc-af83-4e46-aa11-0636cd0cc9f4 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:28.954496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6953dc-af83-4e46-aa11-0636cd0cc9f4 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:28.954606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6953dc-af83-4e46-aa11-0636cd0cc9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:28.973287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-4c6953dc-af83-4e46-aa11-0636cd0cc9f4 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:28.974539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-4c6953dc-af83-4e46-aa11-0636cd0cc9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:29.034359 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:29.205403 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258330f-bf41-42f5-a1ac-dc446643c11c None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:29.207147 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-6258330f-bf41-42f5-a1ac-dc446643c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:29.289914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258330f-bf41-42f5-a1ac-dc446643c11c None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:29.295488 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fc945-4412-4336-87ec-f045df5dfe95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:29.296166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fc945-4412-4336-87ec-f045df5dfe95 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:29.296453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fc945-4412-4336-87ec-f045df5dfe95 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:29.296731 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fc945-4412-4336-87ec-f045df5dfe95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:29.305801 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fc945-4412-4336-87ec-f045df5dfe95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:29.307443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fc945-4412-4336-87ec-f045df5dfe95 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:29.319230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 757/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:48:30.067911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02c16-c005-4019-8da8-06241743431d None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:30.068440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02c16-c005-4019-8da8-06241743431d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:30.068440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02c16-c005-4019-8da8-06241743431d None None] PATH_INFO: `/v3` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:30.069836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 757/1514] 10.222.0.44 () {54 vars in 925 bytes} [Wed May 25 13:48:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:48:30.076040 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33f66-3f53-4b39-9b96-f3080319066c None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:30.076536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33f66-3f53-4b39-9b96-f3080319066c None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:30.076802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e33f66-3f53-4b39-9b96-f3080319066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:30.097094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-08e33f66-3f53-4b39-9b96-f3080319066c None None] MFA Rules not processed for user `ba5bb1004bdc4e74809cc8e43b5d9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:30.098678 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-08e33f66-3f53-4b39-9b96-f3080319066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:30.166484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 758/1515] 10.222.0.44 () {58 vars in 1015 bytes} [Wed May 25 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:30.219060 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b55c6-3fb3-4333-86b0-a5c3c979c981 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:30.219350 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b55c6-3fb3-4333-86b0-a5c3c979c981 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:30.219631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b55c6-3fb3-4333-86b0-a5c3c979c981 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:30.221017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 758/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:30.225768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b79d3-cfe0-4307-a31d-493308b3ef7a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:30.226081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b79d3-cfe0-4307-a31d-493308b3ef7a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:30.226371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b79d3-cfe0-4307-a31d-493308b3ef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:30.245993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-928b79d3-cfe0-4307-a31d-493308b3ef7a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:30.247259 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-928b79d3-cfe0-4307-a31d-493308b3ef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:30.255426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 759/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:30.405976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b55c6-3fb3-4333-86b0-a5c3c979c981 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:30.420017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b55c6-3fb3-4333-86b0-a5c3c979c981 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:30.425326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a13a2c-7b08-404c-9041-df37ce37dcf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:30.426077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a13a2c-7b08-404c-9041-df37ce37dcf9 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:30.426362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a13a2c-7b08-404c-9041-df37ce37dcf9 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:30.426643 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a13a2c-7b08-404c-9041-df37ce37dcf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:30.437170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a13a2c-7b08-404c-9041-df37ce37dcf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:30.439184 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a13a2c-7b08-404c-9041-df37ce37dcf9 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:30.449699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 759/1518] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:48:39.295980 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347ffc0-aa35-4749-a63d-184ea9fbb65b None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:39.296584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347ffc0-aa35-4749-a63d-184ea9fbb65b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:39.296584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347ffc0-aa35-4749-a63d-184ea9fbb65b None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:39.298024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 760/1519] 10.222.0.13 () {54 vars in 960 bytes} [Wed May 25 13:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:39.303794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73122586-463a-423e-9522-96add7da6a63 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:39.304356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73122586-463a-423e-9522-96add7da6a63 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:39.304356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73122586-463a-423e-9522-96add7da6a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:39.325445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-73122586-463a-423e-9522-96add7da6a63 None None] MFA Rules not processed for user `ba5bb1004bdc4e74809cc8e43b5d9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:39.326838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-73122586-463a-423e-9522-96add7da6a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:39.335843 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 760/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Wed May 25 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:39.344316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347ffc0-aa35-4749-a63d-184ea9fbb65b None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:39.360382 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347ffc0-aa35-4749-a63d-184ea9fbb65b None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:39.365435 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c2e73-ad71-4792-8908-5b5ad25673f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba5bb1004bdc4e74809cc8e43b5d9e16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:39.366140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2e73-ad71-4792-8908-5b5ad25673f4 service placement] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:39.366430 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2e73-ad71-4792-8908-5b5ad25673f4 service placement] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:39.366710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2e73-ad71-4792-8908-5b5ad25673f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:39.376753 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c2e73-ad71-4792-8908-5b5ad25673f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:39.378325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c2e73-ad71-4792-8908-5b5ad25673f4 service placement] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:39.389094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 761/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:41.727330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05c4c-7814-43f7-98fa-2bdf7ade66ff None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:41.727911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05c4c-7814-43f7-98fa-2bdf7ade66ff None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:41.727911 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05c4c-7814-43f7-98fa-2bdf7ade66ff None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:41.729317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:41.734243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a0b27-dd5f-4690-bdbc-ec9bb6028ee8 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:41.734731 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a0b27-dd5f-4690-bdbc-ec9bb6028ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:41.734832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a0b27-dd5f-4690-bdbc-ec9bb6028ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:41.753012 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-022a0b27-dd5f-4690-bdbc-ec9bb6028ee8 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:41.754644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-022a0b27-dd5f-4690-bdbc-ec9bb6028ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:41.762993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:41.924837 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f05c4c-7814-43f7-98fa-2bdf7ade66ff None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:41.943526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f05c4c-7814-43f7-98fa-2bdf7ade66ff None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:41.949630 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db026194-233a-4248-9ccc-c107e5f403c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:41.950321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026194-233a-4248-9ccc-c107e5f403c6 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:41.950609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026194-233a-4248-9ccc-c107e5f403c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:41.950899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026194-233a-4248-9ccc-c107e5f403c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:41.959852 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db026194-233a-4248-9ccc-c107e5f403c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:41.961502 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db026194-233a-4248-9ccc-c107e5f403c6 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:41.972604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 762/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:48:42.890837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31374-8b52-4cc9-af23-f7f8b56a70f2 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:42.891413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31374-8b52-4cc9-af23-f7f8b56a70f2 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:42.891413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31374-8b52-4cc9-af23-f7f8b56a70f2 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:42.892851 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 13:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:42.903368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873c84c-10fa-4d3f-b26f-646a83472d7f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:42.904331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873c84c-10fa-4d3f-b26f-646a83472d7f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:42.904695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873c84c-10fa-4d3f-b26f-646a83472d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:42.925353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-8873c84c-10fa-4d3f-b26f-646a83472d7f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:42.926650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-8873c84c-10fa-4d3f-b26f-646a83472d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:42.934780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:43.087568 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b31374-8b52-4cc9-af23-f7f8b56a70f2 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:43.109355 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b31374-8b52-4cc9-af23-f7f8b56a70f2 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:43.114907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cf220-3880-406c-9395-8fd2f13537a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:43.115565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cf220-3880-406c-9395-8fd2f13537a4 service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:43.115863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cf220-3880-406c-9395-8fd2f13537a4 service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:43.116142 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cf220-3880-406c-9395-8fd2f13537a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:43.125447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cf220-3880-406c-9395-8fd2f13537a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:43.127103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cf220-3880-406c-9395-8fd2f13537a4 service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:43.138051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 764/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:47.227592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b99b37-5b2e-4251-aa16-1520ebde7203 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:47.228170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b99b37-5b2e-4251-aa16-1520ebde7203 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:47.228170 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b99b37-5b2e-4251-aa16-1520ebde7203 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:47.229581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:47.234910 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f417-9302-4f36-887e-e7d2489584b5 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:47.235336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f417-9302-4f36-887e-e7d2489584b5 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:47.235475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f417-9302-4f36-887e-e7d2489584b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:47.255951 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-5170f417-9302-4f36-887e-e7d2489584b5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:47.257061 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-5170f417-9302-4f36-887e-e7d2489584b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:47.265607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:47.301220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b99b37-5b2e-4251-aa16-1520ebde7203 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:47.303075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-65b99b37-5b2e-4251-aa16-1520ebde7203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:47.360421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b99b37-5b2e-4251-aa16-1520ebde7203 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:47.363931 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46819ec0-0205-406f-a9b5-0cc28428d1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:47.364581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46819ec0-0205-406f-a9b5-0cc28428d1be service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:47.364867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46819ec0-0205-406f-a9b5-0cc28428d1be service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:47.365145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46819ec0-0205-406f-a9b5-0cc28428d1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:47.374844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46819ec0-0205-406f-a9b5-0cc28428d1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:47.376325 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46819ec0-0205-406f-a9b5-0cc28428d1be service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:47.387703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 765/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:49.641207 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60984-8458-4ed7-bb26-12c0974c4940 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:49.641778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60984-8458-4ed7-bb26-12c0974c4940 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:49.641778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60984-8458-4ed7-bb26-12c0974c4940 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:49.643122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:49.648434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d0ef6-521f-4683-85e5-7fab6787070d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:49.648952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d0ef6-521f-4683-85e5-7fab6787070d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:49.649080 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d0ef6-521f-4683-85e5-7fab6787070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:49.668193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-421d0ef6-521f-4683-85e5-7fab6787070d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:49.669411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-421d0ef6-521f-4683-85e5-7fab6787070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:49.677318 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:49.712508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60984-8458-4ed7-bb26-12c0974c4940 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:49.724007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60984-8458-4ed7-bb26-12c0974c4940 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:49.727570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460604-92c3-442a-bdda-28e0ccad8d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:49.728201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460604-92c3-442a-bdda-28e0ccad8d94 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:49.728493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460604-92c3-442a-bdda-28e0ccad8d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:49.728763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460604-92c3-442a-bdda-28e0ccad8d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:49.738293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd460604-92c3-442a-bdda-28e0ccad8d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:49.739744 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd460604-92c3-442a-bdda-28e0ccad8d94 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:49.749052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 767/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:53.475409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473968db-0193-48b5-af95-e578218f62cf None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:53.475980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473968db-0193-48b5-af95-e578218f62cf None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:53.475980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473968db-0193-48b5-af95-e578218f62cf None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:53.477362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:53.482677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75700e-d4e2-422b-a0bd-26506be9ef08 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:53.483154 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75700e-d4e2-422b-a0bd-26506be9ef08 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:53.483264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75700e-d4e2-422b-a0bd-26506be9ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:53.502500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-6a75700e-d4e2-422b-a0bd-26506be9ef08 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:53.503736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-6a75700e-d4e2-422b-a0bd-26506be9ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:53.512464 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:53.787690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473968db-0193-48b5-af95-e578218f62cf None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:53.789357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-473968db-0193-48b5-af95-e578218f62cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:53.846606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473968db-0193-48b5-af95-e578218f62cf None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:53.850310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de948d9-3cad-4384-81dc-4b5920de990f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:53.850973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de948d9-3cad-4384-81dc-4b5920de990f service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:53.851258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de948d9-3cad-4384-81dc-4b5920de990f service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:53.851546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de948d9-3cad-4384-81dc-4b5920de990f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:53.861754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de948d9-3cad-4384-81dc-4b5920de990f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:53.863247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de948d9-3cad-4384-81dc-4b5920de990f service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:53.868884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:48:53.876079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 768/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:48:56.106170 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352fa5-325e-4ebf-9703-8fba11a64492 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:56.106733 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352fa5-325e-4ebf-9703-8fba11a64492 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:56.106733 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352fa5-325e-4ebf-9703-8fba11a64492 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:56.108029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 13:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:48:56.113292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb224ba-74c8-4f61-931e-912426f0caec None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:56.113722 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb224ba-74c8-4f61-931e-912426f0caec None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:56.113882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb224ba-74c8-4f61-931e-912426f0caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:56.132589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-edb224ba-74c8-4f61-931e-912426f0caec None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:48:56.133846 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-edb224ba-74c8-4f61-931e-912426f0caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:56.142584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 13:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:48:56.417399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47352fa5-325e-4ebf-9703-8fba11a64492 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:48:56.419108 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-47352fa5-325e-4ebf-9703-8fba11a64492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:48:56.432550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47352fa5-325e-4ebf-9703-8fba11a64492 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:48:56.436265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac50b40-2d57-41cd-a587-36e3c33e2cf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:48:56.436911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac50b40-2d57-41cd-a587-36e3c33e2cf4 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:48:56.437195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac50b40-2d57-41cd-a587-36e3c33e2cf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:48:56.437473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac50b40-2d57-41cd-a587-36e3c33e2cf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:48:56.446620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac50b40-2d57-41cd-a587-36e3c33e2cf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:48:56.448784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac50b40-2d57-41cd-a587-36e3c33e2cf4 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:48:56.458260 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 770/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:49:06.129194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:49:06.453965 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:28.307442 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932f84-d441-4325-97b4-4b913ce87037 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.309208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932f84-d441-4325-97b4-4b913ce87037 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.309714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932f84-d441-4325-97b4-4b913ce87037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.342837 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-77932f84-d441-4325-97b4-4b913ce87037 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.344389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-77932f84-d441-4325-97b4-4b913ce87037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.357158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 770/1540] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.368874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba35fe-fddf-455d-a404-a5b403638a67 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.369501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba35fe-fddf-455d-a404-a5b403638a67 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.369501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba35fe-fddf-455d-a404-a5b403638a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.403141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-46ba35fe-fddf-455d-a404-a5b403638a67 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.404480 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-46ba35fe-fddf-455d-a404-a5b403638a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.418095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 771/1541] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.423612 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77932f84-d441-4325-97b4-4b913ce87037 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:28.440261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77932f84-d441-4325-97b4-4b913ce87037 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:28.449397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:28.450123 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.450413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.450696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.451444 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:28.451757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:28.453488 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:28.477099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 771/1542] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:28.485713 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba35fe-fddf-455d-a404-a5b403638a67 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:28.499917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba35fe-fddf-455d-a404-a5b403638a67 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:28.514720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61404f3b-8a58-47d0-a3c6-a5567eb2ccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:28.515436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61404f3b-8a58-47d0-a3c6-a5567eb2ccc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.515734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61404f3b-8a58-47d0-a3c6-a5567eb2ccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.516021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61404f3b-8a58-47d0-a3c6-a5567eb2ccc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.516779 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61404f3b-8a58-47d0-a3c6-a5567eb2ccc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:28.518957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61404f3b-8a58-47d0-a3c6-a5567eb2ccc6 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:28.573502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 772/1543] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:28.578080 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:28.593421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627619c-a931-447f-88c8-3e80b323712a admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:28.612042 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa8861-e06a-4ff8-b5f4-d42e0627f5cb None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.612409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa8861-e06a-4ff8-b5f4-d42e0627f5cb None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.612620 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa8861-e06a-4ff8-b5f4-d42e0627f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.643852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-6afa8861-e06a-4ff8-b5f4-d42e0627f5cb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.645219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-6afa8861-e06a-4ff8-b5f4-d42e0627f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.768807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 773/1544] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:28.770206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9b39-4517-4aa5-825c-b49464907600 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.770911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9b39-4517-4aa5-825c-b49464907600 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.771111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9b39-4517-4aa5-825c-b49464907600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.807273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-358b9b39-4517-4aa5-825c-b49464907600 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.808510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-358b9b39-4517-4aa5-825c-b49464907600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.816935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 774/1545] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.818064 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d25a-4cb2-4768-994f-602d3a7c2264 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.819972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d25a-4cb2-4768-994f-602d3a7c2264 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.819972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d25a-4cb2-4768-994f-602d3a7c2264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.832832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be98d23-c9bd-4687-830a-0a4f1c163732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:28.833421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98d23-c9bd-4687-830a-0a4f1c163732 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.833708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98d23-c9bd-4687-830a-0a4f1c163732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.834124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98d23-c9bd-4687-830a-0a4f1c163732 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.834760 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be98d23-c9bd-4687-830a-0a4f1c163732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:28.836762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be98d23-c9bd-4687-830a-0a4f1c163732 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:28.838132 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-ffa3d25a-4cb2-4768-994f-602d3a7c2264 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.839335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-ffa3d25a-4cb2-4768-994f-602d3a7c2264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.849448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 775/1546] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.851046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997b155-e738-49fe-ae3e-1840e30704de None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.851343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997b155-e738-49fe-ae3e-1840e30704de None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.852140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997b155-e738-49fe-ae3e-1840e30704de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.868365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 772/1547] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:28.869766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf91a4-fe2c-405e-ac47-cd16ab8adb72 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.870069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf91a4-fe2c-405e-ac47-cd16ab8adb72 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.870352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf91a4-fe2c-405e-ac47-cd16ab8adb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.872630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-f997b155-e738-49fe-ae3e-1840e30704de None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.874079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f997b155-e738-49fe-ae3e-1840e30704de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.882975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 776/1548] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.884822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b87c12-093d-4519-9f73-30fe0f94e35b None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.885313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b87c12-093d-4519-9f73-30fe0f94e35b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.885636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b87c12-093d-4519-9f73-30fe0f94e35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.889146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-c0cf91a4-fe2c-405e-ac47-cd16ab8adb72 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.890409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-c0cf91a4-fe2c-405e-ac47-cd16ab8adb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.898598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 773/1549] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.899747 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5725679-7be4-4976-8323-6abde3655f09 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.900037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5725679-7be4-4976-8323-6abde3655f09 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.900484 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5725679-7be4-4976-8323-6abde3655f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.903212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-35b87c12-093d-4519-9f73-30fe0f94e35b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.904415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-35b87c12-093d-4519-9f73-30fe0f94e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.912747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 777/1550] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.914596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3a077-061c-4bc0-a570-ae39fbc433bb None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.914884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3a077-061c-4bc0-a570-ae39fbc433bb None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.915163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3a077-061c-4bc0-a570-ae39fbc433bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.928633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-c5725679-7be4-4976-8323-6abde3655f09 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.930446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-c5725679-7be4-4976-8323-6abde3655f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.933647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-ddf3a077-061c-4bc0-a570-ae39fbc433bb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.934840 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-ddf3a077-061c-4bc0-a570-ae39fbc433bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.938359 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 774/1551] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.939633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c82048-0215-4407-92e7-1ce13ef85945 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.939924 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c82048-0215-4407-92e7-1ce13ef85945 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.940204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c82048-0215-4407-92e7-1ce13ef85945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.948697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 778/1552] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.950451 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd137a-b70e-472e-8a1d-cb38d6c30d36 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.950745 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd137a-b70e-472e-8a1d-cb38d6c30d36 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.951025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd137a-b70e-472e-8a1d-cb38d6c30d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.959907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-20c82048-0215-4407-92e7-1ce13ef85945 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.961178 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-20c82048-0215-4407-92e7-1ce13ef85945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.969396 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 775/1553] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.969717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-5bfd137a-b70e-472e-8a1d-cb38d6c30d36 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:28.970242 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c82048-0215-4407-92e7-1ce13ef85945 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:28.970919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-5bfd137a-b70e-472e-8a1d-cb38d6c30d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:28.980249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c82048-0215-4407-92e7-1ce13ef85945 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:28.980916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 779/1554] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:28.981548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd137a-b70e-472e-8a1d-cb38d6c30d36 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:28.985300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d82e5-0d05-4a93-9545-6bca1867e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:28.986019 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d82e5-0d05-4a93-9545-6bca1867e1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:28.986890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d82e5-0d05-4a93-9545-6bca1867e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:28.986890 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d82e5-0d05-4a93-9545-6bca1867e1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:28.987315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d82e5-0d05-4a93-9545-6bca1867e1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:28.989057 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d82e5-0d05-4a93-9545-6bca1867e1c7 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:28.991424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd137a-b70e-472e-8a1d-cb38d6c30d36 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.000926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 776/1555] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:29.002284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66952232-a612-4097-8c64-82f0156bb80d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.002582 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66952232-a612-4097-8c64-82f0156bb80d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.002922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66952232-a612-4097-8c64-82f0156bb80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.004367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c918-0ff8-4456-a7a2-fa05fd0f24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.005048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c918-0ff8-4456-a7a2-fa05fd0f24b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.005339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c918-0ff8-4456-a7a2-fa05fd0f24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.005614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c918-0ff8-4456-a7a2-fa05fd0f24b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.006498 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c918-0ff8-4456-a7a2-fa05fd0f24b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:29.006699 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c918-0ff8-4456-a7a2-fa05fd0f24b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.007768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING py.warnings [None req-c4f9c918-0ff8-4456-a7a2-fa05fd0f24b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 13:50:29.007768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: warnings.warn(msg) May 25 13:50:29.007768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: May 25 13:50:29.008673 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c918-0ff8-4456-a7a2-fa05fd0f24b0 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.020889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 780/1556] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:29.021906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705935eb-c18e-4865-95fd-9490f898cfac None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.022197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705935eb-c18e-4865-95fd-9490f898cfac None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.022475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705935eb-c18e-4865-95fd-9490f898cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.025404 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-66952232-a612-4097-8c64-82f0156bb80d None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:29.027583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-66952232-a612-4097-8c64-82f0156bb80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:29.035338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 777/1557] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:29.036708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d3c24-9e23-411f-a933-af17e2a61ef0 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.036967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d3c24-9e23-411f-a933-af17e2a61ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.037233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d3c24-9e23-411f-a933-af17e2a61ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.043756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-705935eb-c18e-4865-95fd-9490f898cfac None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:29.045000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-705935eb-c18e-4865-95fd-9490f898cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:29.054193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 781/1558] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:29.056048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b7af-7019-4c84-8169-07265884f9d6 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.056330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b7af-7019-4c84-8169-07265884f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.056592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-933d3c24-9e23-411f-a933-af17e2a61ef0 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:29.056701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b7af-7019-4c84-8169-07265884f9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.057559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-933d3c24-9e23-411f-a933-af17e2a61ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:29.066256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 778/1559] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:29.067152 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d3c24-9e23-411f-a933-af17e2a61ef0 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.076408 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-38b2b7af-7019-4c84-8169-07265884f9d6 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:29.077623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-38b2b7af-7019-4c84-8169-07265884f9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:29.078315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d3c24-9e23-411f-a933-af17e2a61ef0 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.083103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.083702 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.083988 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.084265 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.085008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:29.085342 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.085999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 782/1560] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:29.086794 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b7af-7019-4c84-8169-07265884f9d6 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.086995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.096314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b7af-7019-4c84-8169-07265884f9d6 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.107238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 779/1561] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:29.107454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.107592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.107702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.107702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.107702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.107702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:29.107702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.107702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.113616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cccf56-a15d-422a-8a9f-c710c8fb9491 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.119155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96a0f3-903b-4cb2-a6a2-544d8c0316d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.119869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 783/1562] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:29.120006 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a0f3-903b-4cb2-a6a2-544d8c0316d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.120146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a0f3-903b-4cb2-a6a2-544d8c0316d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.120453 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a0f3-903b-4cb2-a6a2-544d8c0316d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.121238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.121362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96a0f3-903b-4cb2-a6a2-544d8c0316d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.123145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96a0f3-903b-4cb2-a6a2-544d8c0316d3 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.134536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de98577-6c4c-4d81-8258-7d57443df5bd admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.138563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 780/1563] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:29.138563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96a0f3-903b-4cb2-a6a2-544d8c0316d3 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.141960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8b281-12d2-4065-bed0-6ee0f531a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.141960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8b281-12d2-4065-bed0-6ee0f531a51c admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.141960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8b281-12d2-4065-bed0-6ee0f531a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.141960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8b281-12d2-4065-bed0-6ee0f531a51c admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.142285 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8b281-12d2-4065-bed0-6ee0f531a51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.144131 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8b281-12d2-4065-bed0-6ee0f531a51c admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.151730 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96a0f3-903b-4cb2-a6a2-544d8c0316d3 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.156362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.157048 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.157427 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.157696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.158442 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:29.158749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.160360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.172421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 784/1564] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.173385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8b281-12d2-4065-bed0-6ee0f531a51c admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.177904 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 781/1565] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:29.178693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.190153 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b0bc-5483-499c-ad19-1cae24db2544 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.212945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.238142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.244872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8b281-12d2-4065-bed0-6ee0f531a51c admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.249823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.250497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.250786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.251068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.251771 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.251932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:29.252106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.252474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.252782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.253061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.253719 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.254226 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:29.254535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.256549 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.273824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 785/1566] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:29.273824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.274138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 782/1567] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:29.274138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.283910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8eab-9f6e-48ce-bca1-671964a43df5 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.285203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266acd-cb33-46b2-affb-1f73a8396b63 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.288360 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.289616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.289903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.290177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.290427 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.290862 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.291090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.291378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.291664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.291935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING py.warnings [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:50:29.291935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: warnings.warn(msg) May 25 13:50:29.291935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: May 25 13:50:29.292399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:29.292711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.293120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.294380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.309888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 786/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:29.310805 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.321542 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dbe16-b382-4326-9e5a-ffd57223a55b admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.326740 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789f19a-f27c-4a85-ab1a-83817648e7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.327406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789f19a-f27c-4a85-ab1a-83817648e7af admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.327690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789f19a-f27c-4a85-ab1a-83817648e7af admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.327969 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789f19a-f27c-4a85-ab1a-83817648e7af admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.328665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789f19a-f27c-4a85-ab1a-83817648e7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.330616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789f19a-f27c-4a85-ab1a-83817648e7af admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.331391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 783/1569] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.332224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.365526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 787/1570] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.365526 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789f19a-f27c-4a85-ab1a-83817648e7af admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.401357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd09a7-2f43-4c0a-859f-f82f6b7bf50c admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.425831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789f19a-f27c-4a85-ab1a-83817648e7af admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.430566 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.431280 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.431587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.431866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.432607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.433630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING py.warnings [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:50:29.433630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: warnings.warn(msg) May 25 13:50:29.433630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: May 25 13:50:29.434883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.456452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 788/1571] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.457349 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.464291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.465450 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.466373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.466921 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] PATH_INFO: `/v3/projects/65c215436a474581bc8f967d942c32f4/users/6f66a907c810404aa8e2edfffaffc608/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.469642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b2508-d80b-4fdf-92dc-464e913e242e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.474522 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41531ff3-9fe6-4f64-b1bb-a498a1cef738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.475181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41531ff3-9fe6-4f64-b1bb-a498a1cef738 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.475468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41531ff3-9fe6-4f64-b1bb-a498a1cef738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.475747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41531ff3-9fe6-4f64-b1bb-a498a1cef738 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.476513 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41531ff3-9fe6-4f64-b1bb-a498a1cef738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.479104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41531ff3-9fe6-4f64-b1bb-a498a1cef738 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.483306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c215436a474581bc8f967d942c32f4, user_id=6f66a907c810404aa8e2edfffaffc608, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.484364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING py.warnings [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:50:29.484364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: warnings.warn(msg) May 25 13:50:29.484364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: May 25 13:50:29.486340 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.500718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 784/1572] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:29 2022] PUT /identity/v3/projects/65c215436a474581bc8f967d942c32f4/users/6f66a907c810404aa8e2edfffaffc608/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:29.501770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.507891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 789/1573] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.508719 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41531ff3-9fe6-4f64-b1bb-a498a1cef738 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.563039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.575174 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.575364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28bdf1-25f2-4cd6-aaca-1ca514622aa2 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.579334 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41531ff3-9fe6-4f64-b1bb-a498a1cef738 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.580342 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b6347-30e2-46fc-8e0a-83ae5aa8a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.581009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6347-30e2-46fc-8e0a-83ae5aa8a01f admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.581298 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6347-30e2-46fc-8e0a-83ae5aa8a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.581586 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b6347-30e2-46fc-8e0a-83ae5aa8a01f admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.582651 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b6347-30e2-46fc-8e0a-83ae5aa8a01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.585124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b6347-30e2-46fc-8e0a-83ae5aa8a01f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.585637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e28102-6492-4a5a-b772-16227e85ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.586861 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28102-6492-4a5a-b772-16227e85ce5d admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.587151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28102-6492-4a5a-b772-16227e85ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.587434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28102-6492-4a5a-b772-16227e85ce5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.588132 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e28102-6492-4a5a-b772-16227e85ce5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.590089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e28102-6492-4a5a-b772-16227e85ce5d admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.612612 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 785/1574] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.613438 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b6347-30e2-46fc-8e0a-83ae5aa8a01f admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.615707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 790/1575] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.616567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e28102-6492-4a5a-b772-16227e85ce5d admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.676833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b6347-30e2-46fc-8e0a-83ae5aa8a01f admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.680917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e28102-6492-4a5a-b772-16227e85ce5d admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.682329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413c14-fd48-45de-8941-ff457742bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.683034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413c14-fd48-45de-8941-ff457742bb12 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.683326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413c14-fd48-45de-8941-ff457742bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.683607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413c14-fd48-45de-8941-ff457742bb12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.684304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8413c14-fd48-45de-8941-ff457742bb12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.685955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9d30-9e8c-4f08-a326-528f52ffafef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.686281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8413c14-fd48-45de-8941-ff457742bb12 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.686541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9d30-9e8c-4f08-a326-528f52ffafef admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.686860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9d30-9e8c-4f08-a326-528f52ffafef admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.687140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9d30-9e8c-4f08-a326-528f52ffafef admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.687832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9d30-9e8c-4f08-a326-528f52ffafef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.689878 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9d30-9e8c-4f08-a326-528f52ffafef admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.716897 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 786/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.717149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 791/1577] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.717269 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413c14-fd48-45de-8941-ff457742bb12 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.717375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9d30-9e8c-4f08-a326-528f52ffafef admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.725809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9d30-9e8c-4f08-a326-528f52ffafef admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.779583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413c14-fd48-45de-8941-ff457742bb12 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.784078 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d1931-ceff-4adb-a28f-deff7cb9550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.784756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1931-ceff-4adb-a28f-deff7cb9550c admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.785043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1931-ceff-4adb-a28f-deff7cb9550c admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.785324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1931-ceff-4adb-a28f-deff7cb9550c admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.786143 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d1931-ceff-4adb-a28f-deff7cb9550c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.786708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6834d-ce96-403f-8ebb-52c1478c9f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.787399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6834d-ce96-403f-8ebb-52c1478c9f26 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.787690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6834d-ce96-403f-8ebb-52c1478c9f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.787797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d1931-ceff-4adb-a28f-deff7cb9550c admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.787969 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6834d-ce96-403f-8ebb-52c1478c9f26 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.788684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6834d-ce96-403f-8ebb-52c1478c9f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.790691 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6834d-ce96-403f-8ebb-52c1478c9f26 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.799135 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 792/1578] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:29.803774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e3ac7-6f8b-4a77-85d0-cccd6e0a8b4a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.804096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e3ac7-6f8b-4a77-85d0-cccd6e0a8b4a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.804525 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e3ac7-6f8b-4a77-85d0-cccd6e0a8b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.811946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 787/1579] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.812774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6834d-ce96-403f-8ebb-52c1478c9f26 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.822651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-e82e3ac7-6f8b-4a77-85d0-cccd6e0a8b4a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:29.823299 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6834d-ce96-403f-8ebb-52c1478c9f26 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.823958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-e82e3ac7-6f8b-4a77-85d0-cccd6e0a8b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:29.827965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd72b7-316a-4b17-b0d9-c6e1339f6799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.828634 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd72b7-316a-4b17-b0d9-c6e1339f6799 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.828918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd72b7-316a-4b17-b0d9-c6e1339f6799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.829196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd72b7-316a-4b17-b0d9-c6e1339f6799 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.829923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd72b7-316a-4b17-b0d9-c6e1339f6799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.831831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd72b7-316a-4b17-b0d9-c6e1339f6799 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.832256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 793/1580] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:29.833038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e3ac7-6f8b-4a77-85d0-cccd6e0a8b4a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.845613 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e3ac7-6f8b-4a77-85d0-cccd6e0a8b4a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.850841 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d1213-f36f-4962-81cd-e14804b22f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.851551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d1213-f36f-4962-81cd-e14804b22f26 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.851836 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d1213-f36f-4962-81cd-e14804b22f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.852114 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d1213-f36f-4962-81cd-e14804b22f26 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.852811 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d1213-f36f-4962-81cd-e14804b22f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.856125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 788/1581] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/users => generated 303 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.856125 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd72b7-316a-4b17-b0d9-c6e1339f6799 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.856376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d1213-f36f-4962-81cd-e14804b22f26 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.864059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd72b7-316a-4b17-b0d9-c6e1339f6799 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.869455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e12726-ca73-4cd7-80e5-2914988a78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.870168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12726-ca73-4cd7-80e5-2914988a78d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.870449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12726-ca73-4cd7-80e5-2914988a78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.870733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12726-ca73-4cd7-80e5-2914988a78d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.871486 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e12726-ca73-4cd7-80e5-2914988a78d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.873506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e12726-ca73-4cd7-80e5-2914988a78d0 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.875758 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 794/1582] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.879143 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d1213-f36f-4962-81cd-e14804b22f26 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.887532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d1213-f36f-4962-81cd-e14804b22f26 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.893379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a1c1-5714-4ca7-b9f3-b1ea0dbef20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.894093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a1c1-5714-4ca7-b9f3-b1ea0dbef20e admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.894395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a1c1-5714-4ca7-b9f3-b1ea0dbef20e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.894682 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a1c1-5714-4ca7-b9f3-b1ea0dbef20e admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.895419 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23a1c1-5714-4ca7-b9f3-b1ea0dbef20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.895544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 789/1583] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.896430 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e12726-ca73-4cd7-80e5-2914988a78d0 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.897032 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23a1c1-5714-4ca7-b9f3-b1ea0dbef20e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.906898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e12726-ca73-4cd7-80e5-2914988a78d0 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.911506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 795/1584] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:29.911506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a1c1-5714-4ca7-b9f3-b1ea0dbef20e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.911939 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc30f-7ab2-4d3a-8512-00bb0da6eb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.912617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc30f-7ab2-4d3a-8512-00bb0da6eb81 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.912908 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc30f-7ab2-4d3a-8512-00bb0da6eb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.913191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc30f-7ab2-4d3a-8512-00bb0da6eb81 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.914024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc30f-7ab2-4d3a-8512-00bb0da6eb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.915980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc30f-7ab2-4d3a-8512-00bb0da6eb81 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.919106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a1c1-5714-4ca7-b9f3-b1ea0dbef20e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.923800 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e073c2-0bb2-4c43-9f1d-1a05a45435c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.924461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e073c2-0bb2-4c43-9f1d-1a05a45435c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.924747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e073c2-0bb2-4c43-9f1d-1a05a45435c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.925033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e073c2-0bb2-4c43-9f1d-1a05a45435c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.925795 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e073c2-0bb2-4c43-9f1d-1a05a45435c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.927686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e073c2-0bb2-4c43-9f1d-1a05a45435c9 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.931046 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=86,keystone:INSERT=14 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.941433 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 790/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:29 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:29.941631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 796/1586] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:29.941749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc30f-7ab2-4d3a-8512-00bb0da6eb81 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.941860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e073c2-0bb2-4c43-9f1d-1a05a45435c9 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.950803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc30f-7ab2-4d3a-8512-00bb0da6eb81 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.955404 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37182a5-e976-40a7-a710-0878cdeff5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.956168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37182a5-e976-40a7-a710-0878cdeff5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.956349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37182a5-e976-40a7-a710-0878cdeff5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.956625 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37182a5-e976-40a7-a710-0878cdeff5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.957393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37182a5-e976-40a7-a710-0878cdeff5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.959037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37182a5-e976-40a7-a710-0878cdeff5b3 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:29.970083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:29.970275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 791/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:29.971342 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37182a5-e976-40a7-a710-0878cdeff5b3 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:29.989073 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37182a5-e976-40a7-a710-0878cdeff5b3 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:29.994967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a3947-f8d6-4828-bfbd-be33e7f047d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:29.995652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3947-f8d6-4828-bfbd-be33e7f047d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:29.995936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3947-f8d6-4828-bfbd-be33e7f047d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:29.996216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3947-f8d6-4828-bfbd-be33e7f047d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:29.996949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a3947-f8d6-4828-bfbd-be33e7f047d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:29.998621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a3947-f8d6-4828-bfbd-be33e7f047d4 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.008563 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e073c2-0bb2-4c43-9f1d-1a05a45435c9 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.010390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 792/1588] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.011395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a3947-f8d6-4828-bfbd-be33e7f047d4 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.012587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1eff-619c-4c7d-873d-b66cc1642b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.013361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1eff-619c-4c7d-873d-b66cc1642b9f service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.013665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1eff-619c-4c7d-873d-b66cc1642b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.013991 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1eff-619c-4c7d-873d-b66cc1642b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.020959 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a3947-f8d6-4828-bfbd-be33e7f047d4 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.023792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e1eff-619c-4c7d-873d-b66cc1642b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.025265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e1eff-619c-4c7d-873d-b66cc1642b9f service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.025639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e5ae8-f9f9-4a75-816c-e4c9cb9e3b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.026346 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5ae8-f9f9-4a75-816c-e4c9cb9e3b37 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.026634 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5ae8-f9f9-4a75-816c-e4c9cb9e3b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.026915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5ae8-f9f9-4a75-816c-e4c9cb9e3b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.027671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e5ae8-f9f9-4a75-816c-e4c9cb9e3b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.029288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e5ae8-f9f9-4a75-816c-e4c9cb9e3b37 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.038341 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 797/1589] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:30.039300 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1eff-619c-4c7d-873d-b66cc1642b9f service neutron] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.044239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 793/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.044239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e5ae8-f9f9-4a75-816c-e4c9cb9e3b37 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.052131 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1eff-619c-4c7d-873d-b66cc1642b9f service neutron] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.058541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47209d-60e6-447a-8408-0b1cc76adc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.058769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e5ae8-f9f9-4a75-816c-e4c9cb9e3b37 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.059270 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47209d-60e6-447a-8408-0b1cc76adc50 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.059558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47209d-60e6-447a-8408-0b1cc76adc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.059840 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47209d-60e6-447a-8408-0b1cc76adc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.060792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47209d-60e6-447a-8408-0b1cc76adc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.062508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47209d-60e6-447a-8408-0b1cc76adc50 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.065934 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5ec22-8c1f-430e-80a6-cc7a4ff7525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.066752 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5ec22-8c1f-430e-80a6-cc7a4ff7525f admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.067108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5ec22-8c1f-430e-80a6-cc7a4ff7525f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.067532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5ec22-8c1f-430e-80a6-cc7a4ff7525f admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.068652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5ec22-8c1f-430e-80a6-cc7a4ff7525f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.071896 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5ec22-8c1f-430e-80a6-cc7a4ff7525f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.076268 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 798/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.080085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47209d-60e6-447a-8408-0b1cc76adc50 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.087460 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 794/1592] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.088235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5ec22-8c1f-430e-80a6-cc7a4ff7525f admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.088357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47209d-60e6-447a-8408-0b1cc76adc50 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.093965 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7aed5-1754-46b2-bc72-b41d0ef69699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.094520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7aed5-1754-46b2-bc72-b41d0ef69699 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.094810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7aed5-1754-46b2-bc72-b41d0ef69699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.095092 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7aed5-1754-46b2-bc72-b41d0ef69699 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.096047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7aed5-1754-46b2-bc72-b41d0ef69699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.097454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7aed5-1754-46b2-bc72-b41d0ef69699 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.100737 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5ec22-8c1f-430e-80a6-cc7a4ff7525f admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.106214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419fc4f-3c40-42b4-b335-9a8fed21bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.107187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419fc4f-3c40-42b4-b335-9a8fed21bca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.107550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419fc4f-3c40-42b4-b335-9a8fed21bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.107899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419fc4f-3c40-42b4-b335-9a8fed21bca0 admin admin] PATH_INFO: `/v3/projects/787c6571c61047dfb99c4ae663503641/users/255c53c1a3134e4eac070a66fec7aa52/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.111868 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 799/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.111868 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7aed5-1754-46b2-bc72-b41d0ef69699 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.122887 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7aed5-1754-46b2-bc72-b41d0ef69699 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.128292 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b14ee-f38a-46f6-a82c-2f6a05a47c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.128972 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b14ee-f38a-46f6-a82c-2f6a05a47c4b admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.129267 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b14ee-f38a-46f6-a82c-2f6a05a47c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.129604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b14ee-f38a-46f6-a82c-2f6a05a47c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.129928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419fc4f-3c40-42b4-b335-9a8fed21bca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=787c6571c61047dfb99c4ae663503641, user_id=255c53c1a3134e4eac070a66fec7aa52, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.130389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b14ee-f38a-46f6-a82c-2f6a05a47c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.132603 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b14ee-f38a-46f6-a82c-2f6a05a47c4b admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.134094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419fc4f-3c40-42b4-b335-9a8fed21bca0 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.146095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 800/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.147323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b14ee-f38a-46f6-a82c-2f6a05a47c4b admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.155568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 795/1595] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:30 2022] PUT /identity/v3/projects/787c6571c61047dfb99c4ae663503641/users/255c53c1a3134e4eac070a66fec7aa52/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:30.161969 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419fc4f-3c40-42b4-b335-9a8fed21bca0 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.167773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b14ee-f38a-46f6-a82c-2f6a05a47c4b admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.231995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419fc4f-3c40-42b4-b335-9a8fed21bca0 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.237176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f681-c5ba-4032-91f9-723a760269a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.240009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f681-c5ba-4032-91f9-723a760269a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.240009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f681-c5ba-4032-91f9-723a760269a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.240009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f681-c5ba-4032-91f9-723a760269a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.240009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585f681-c5ba-4032-91f9-723a760269a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.241003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585f681-c5ba-4032-91f9-723a760269a9 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.256753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 796/1596] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.259176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f681-c5ba-4032-91f9-723a760269a9 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.268969 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d8a4-9d3b-4933-b18a-bb162b5e13a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.269809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f681-c5ba-4032-91f9-723a760269a9 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.270042 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d8a4-9d3b-4933-b18a-bb162b5e13a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.270629 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d8a4-9d3b-4933-b18a-bb162b5e13a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.271123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d8a4-9d3b-4933-b18a-bb162b5e13a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.272054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2d8a4-9d3b-4933-b18a-bb162b5e13a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.273659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2d8a4-9d3b-4933-b18a-bb162b5e13a8 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.274744 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9aaa0e-84ec-4956-83b0-2025dcd0e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.275425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aaa0e-84ec-4956-83b0-2025dcd0e695 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.275716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aaa0e-84ec-4956-83b0-2025dcd0e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.276000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aaa0e-84ec-4956-83b0-2025dcd0e695 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.277072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9aaa0e-84ec-4956-83b0-2025dcd0e695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.278538 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9aaa0e-84ec-4956-83b0-2025dcd0e695 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.286769 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 801/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.294815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 797/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.294993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d8a4-9d3b-4933-b18a-bb162b5e13a8 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.295113 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9aaa0e-84ec-4956-83b0-2025dcd0e695 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.302891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d8a4-9d3b-4933-b18a-bb162b5e13a8 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.305356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9aaa0e-84ec-4956-83b0-2025dcd0e695 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.309060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54d6d-6e66-45c6-9990-d5b305a6314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.310245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76c0db-279f-48df-92a5-f41da123bba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.310553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54d6d-6e66-45c6-9990-d5b305a6314f admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.311577 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76c0db-279f-48df-92a5-f41da123bba7 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.311771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54d6d-6e66-45c6-9990-d5b305a6314f admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.311771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54d6d-6e66-45c6-9990-d5b305a6314f admin admin] PATH_INFO: `/v3/projects/ebe9dd3b6cf64559953f69c0d9b5d074/users/ad7e41008d2f4502b13938e0a9ba79de/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.312130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76c0db-279f-48df-92a5-f41da123bba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.312130 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76c0db-279f-48df-92a5-f41da123bba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.312495 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76c0db-279f-48df-92a5-f41da123bba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.314181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76c0db-279f-48df-92a5-f41da123bba7 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.330671 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c54d6d-6e66-45c6-9990-d5b305a6314f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe9dd3b6cf64559953f69c0d9b5d074, user_id=ad7e41008d2f4502b13938e0a9ba79de, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.333545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c54d6d-6e66-45c6-9990-d5b305a6314f admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.335201 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 798/1599] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:30.336745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76c0db-279f-48df-92a5-f41da123bba7 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.364180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 802/1600] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:30 2022] PUT /identity/v3/projects/ebe9dd3b6cf64559953f69c0d9b5d074/users/ad7e41008d2f4502b13938e0a9ba79de/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:30.364418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76c0db-279f-48df-92a5-f41da123bba7 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.364524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfe6b-0b58-4720-9750-4c5de14e8273 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.364911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfe6b-0b58-4720-9750-4c5de14e8273 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.365073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfe6b-0b58-4720-9750-4c5de14e8273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.406003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-27dbfe6b-0b58-4720-9750-4c5de14e8273 None None] MFA Rules not processed for user `255c53c1a3134e4eac070a66fec7aa52`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:30.407464 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-27dbfe6b-0b58-4720-9750-4c5de14e8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:30.442187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c8cc9-1d0d-45de-b717-aa906ebae51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.443159 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c8cc9-1d0d-45de-b717-aa906ebae51f admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.443452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c8cc9-1d0d-45de-b717-aa906ebae51f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.443731 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c8cc9-1d0d-45de-b717-aa906ebae51f admin admin] PATH_INFO: `/v3/projects/7bf387673bc24d72b47bf6fa305012e6/users/e1ccb7ed06164e6592dae890f5d6fbe9/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.457152 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.469847 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c8cc9-1d0d-45de-b717-aa906ebae51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf387673bc24d72b47bf6fa305012e6, user_id=e1ccb7ed06164e6592dae890f5d6fbe9, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.473552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c8cc9-1d0d-45de-b717-aa906ebae51f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.493906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.499213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 799/1601] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:30 2022] PUT /identity/v3/projects/7bf387673bc24d72b47bf6fa305012e6/users/e1ccb7ed06164e6592dae890f5d6fbe9/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:30.501521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c8cc9-1d0d-45de-b717-aa906ebae51f admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.515952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 803/1602] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:30.516949 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbfe6b-0b58-4720-9750-4c5de14e8273 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.531983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbfe6b-0b58-4720-9750-4c5de14e8273 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.580500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c8cc9-1d0d-45de-b717-aa906ebae51f admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.587086 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caac958-510c-4f20-af23-9034341d852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.588276 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caac958-510c-4f20-af23-9034341d852b admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.588568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caac958-510c-4f20-af23-9034341d852b admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.588848 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caac958-510c-4f20-af23-9034341d852b admin admin] PATH_INFO: `/v3/projects/560f232f1bab431591cf805a76f00132/users/04e1c5462d614e1cb1153fa28c901a04/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.602684 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcaec5-a8ff-495a-b864-4bd4540b2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.603712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcaec5-a8ff-495a-b864-4bd4540b2583 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.604057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcaec5-a8ff-495a-b864-4bd4540b2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.604399 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcaec5-a8ff-495a-b864-4bd4540b2583 admin admin] PATH_INFO: `/v3/projects/bb1c59e24deb4fca9ac689298bcaa6dc/users/075509b1fe844621ad01c9330fbd1657/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.606711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caac958-510c-4f20-af23-9034341d852b admin admin] RBAC: Authorizing `identity:create_grant(project_id=560f232f1bab431591cf805a76f00132, user_id=04e1c5462d614e1cb1153fa28c901a04, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.609393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caac958-510c-4f20-af23-9034341d852b admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.621879 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcaec5-a8ff-495a-b864-4bd4540b2583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1c59e24deb4fca9ac689298bcaa6dc, user_id=075509b1fe844621ad01c9330fbd1657, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.625028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcaec5-a8ff-495a-b864-4bd4540b2583 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.627434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 800/1603] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:30 2022] PUT /identity/v3/projects/560f232f1bab431591cf805a76f00132/users/04e1c5462d614e1cb1153fa28c901a04/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:30.628198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caac958-510c-4f20-af23-9034341d852b admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.642830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 804/1604] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:30 2022] PUT /identity/v3/projects/bb1c59e24deb4fca9ac689298bcaa6dc/users/075509b1fe844621ad01c9330fbd1657/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:30.644341 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcaec5-a8ff-495a-b864-4bd4540b2583 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:30.705380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caac958-510c-4f20-af23-9034341d852b admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.723717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcaec5-a8ff-495a-b864-4bd4540b2583 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:30.729892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04ceb1-f0b8-4c5e-ba0c-97831f1532b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.730960 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04ceb1-f0b8-4c5e-ba0c-97831f1532b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.731250 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04ceb1-f0b8-4c5e-ba0c-97831f1532b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.731577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04ceb1-f0b8-4c5e-ba0c-97831f1532b7 admin admin] PATH_INFO: `/v3/projects/8bb69e0b547044278e38faa818adce3f/users/56b58db3d121448f8dfee5629f9567fb/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.749423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04ceb1-f0b8-4c5e-ba0c-97831f1532b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb69e0b547044278e38faa818adce3f, user_id=56b58db3d121448f8dfee5629f9567fb, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.752395 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04ceb1-f0b8-4c5e-ba0c-97831f1532b7 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.781591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 805/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:30 2022] PUT /identity/v3/projects/8bb69e0b547044278e38faa818adce3f/users/56b58db3d121448f8dfee5629f9567fb/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:30.781591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86553-28fd-4a3a-a054-9a2edebfd626 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.781591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86553-28fd-4a3a-a054-9a2edebfd626 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.781591 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86553-28fd-4a3a-a054-9a2edebfd626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.787807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801cabe-65e7-44cb-8885-040af8fbd9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:30.789726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801cabe-65e7-44cb-8885-040af8fbd9de admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.790117 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801cabe-65e7-44cb-8885-040af8fbd9de admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.794791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801cabe-65e7-44cb-8885-040af8fbd9de admin admin] PATH_INFO: `/v3/projects/b0ed6349e1e543a58f66517ac387c762/users/d515f8ff5700462aa78ee3b9187c0f2e/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.822821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-86e86553-28fd-4a3a-a054-9a2edebfd626 None None] MFA Rules not processed for user `ad7e41008d2f4502b13938e0a9ba79de`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:30.823045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-86e86553-28fd-4a3a-a054-9a2edebfd626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:30.825696 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801cabe-65e7-44cb-8885-040af8fbd9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ed6349e1e543a58f66517ac387c762, user_id=d515f8ff5700462aa78ee3b9187c0f2e, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:30.829354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801cabe-65e7-44cb-8885-040af8fbd9de admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:30.842645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.860790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 801/1606] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:30 2022] PUT /identity/v3/projects/b0ed6349e1e543a58f66517ac387c762/users/d515f8ff5700462aa78ee3b9187c0f2e/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:30.862581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dab3b-563e-4c81-b6fc-6935eeb57226 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:30.862947 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dab3b-563e-4c81-b6fc-6935eeb57226 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:30.863312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dab3b-563e-4c81-b6fc-6935eeb57226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:30.886097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-c00dab3b-563e-4c81-b6fc-6935eeb57226 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:30.886097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-c00dab3b-563e-4c81-b6fc-6935eeb57226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:30.903686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:30.933810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 806/1607] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:30.935047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e86553-28fd-4a3a-a054-9a2edebfd626 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.008275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 802/1608] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:31.010024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c53cf-77a5-43f1-bfce-77a323cc4154 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.010475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c53cf-77a5-43f1-bfce-77a323cc4154 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.010928 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c53cf-77a5-43f1-bfce-77a323cc4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.041568 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e86553-28fd-4a3a-a054-9a2edebfd626 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.043906 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-421c53cf-77a5-43f1-bfce-77a323cc4154 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:31.045443 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-421c53cf-77a5-43f1-bfce-77a323cc4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:31.047136 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314ee8a-2f07-4492-a394-8707f1643eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.048038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ee8a-2f07-4492-a394-8707f1643eac admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.048436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ee8a-2f07-4492-a394-8707f1643eac admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.050252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ee8a-2f07-4492-a394-8707f1643eac admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.051094 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314ee8a-2f07-4492-a394-8707f1643eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.055894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314ee8a-2f07-4492-a394-8707f1643eac admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.060367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 803/1609] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:31.060367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf688c-f73b-439e-8ef0-c9fbf978d7bb None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.060367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf688c-f73b-439e-8ef0-c9fbf978d7bb None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.060367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf688c-f73b-439e-8ef0-c9fbf978d7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.082233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-6eaf688c-f73b-439e-8ef0-c9fbf978d7bb None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:31.083675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-6eaf688c-f73b-439e-8ef0-c9fbf978d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:31.095507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 804/1610] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:31.097494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc832-3b9a-4466-aada-a1429d638eba None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.097896 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc832-3b9a-4466-aada-a1429d638eba None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.098338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc832-3b9a-4466-aada-a1429d638eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.109831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 807/1611] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:30 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:31.114303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba08c8-3f81-406d-8815-e551db2845f6 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.114756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba08c8-3f81-406d-8815-e551db2845f6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.115052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba08c8-3f81-406d-8815-e551db2845f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.133416 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b66dc832-3b9a-4466-aada-a1429d638eba None None] MFA Rules not processed for user `56b58db3d121448f8dfee5629f9567fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:31.135100 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b66dc832-3b9a-4466-aada-a1429d638eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:31.152054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-7dba08c8-3f81-406d-8815-e551db2845f6 None None] MFA Rules not processed for user `d515f8ff5700462aa78ee3b9187c0f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:31.154123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-7dba08c8-3f81-406d-8815-e551db2845f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:31.225362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 805/1612] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:31.227003 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dc832-3b9a-4466-aada-a1429d638eba None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.275980 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 808/1613] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:31.277858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba08c8-3f81-406d-8815-e551db2845f6 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.282418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-7dba08c8-3f81-406d-8815-e551db2845f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:31.340284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dc832-3b9a-4466-aada-a1429d638eba None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.346038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756b451-db0f-4586-918e-3927ad5a2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.346976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756b451-db0f-4586-918e-3927ad5a2011 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.347364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756b451-db0f-4586-918e-3927ad5a2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.347978 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756b451-db0f-4586-918e-3927ad5a2011 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.348684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756b451-db0f-4586-918e-3927ad5a2011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.350907 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756b451-db0f-4586-918e-3927ad5a2011 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.387206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 806/1614] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:31.387206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756b451-db0f-4586-918e-3927ad5a2011 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.390653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.392604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba08c8-3f81-406d-8815-e551db2845f6 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.415524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.461403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756b451-db0f-4586-918e-3927ad5a2011 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.466840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48405a-5457-441d-bb5b-a9114f91cc7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.467519 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48405a-5457-441d-bb5b-a9114f91cc7c service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.467810 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48405a-5457-441d-bb5b-a9114f91cc7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.468092 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48405a-5457-441d-bb5b-a9114f91cc7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.470332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6db5d-7640-4b0a-b863-5205e94be01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.471342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6db5d-7640-4b0a-b863-5205e94be01a service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.471782 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6db5d-7640-4b0a-b863-5205e94be01a service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.472245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6db5d-7640-4b0a-b863-5205e94be01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.548940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48405a-5457-441d-bb5b-a9114f91cc7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.550544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48405a-5457-441d-bb5b-a9114f91cc7c service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.562633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6db5d-7640-4b0a-b863-5205e94be01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.564117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6db5d-7640-4b0a-b863-5205e94be01a service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.569250 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 807/1615] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:31.570466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48405a-5457-441d-bb5b-a9114f91cc7c service neutron] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.582361 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48405a-5457-441d-bb5b-a9114f91cc7c service neutron] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.589235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d25a56-7390-4bdc-a883-4cbadf8e653d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.590400 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d25a56-7390-4bdc-a883-4cbadf8e653d service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.590842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d25a56-7390-4bdc-a883-4cbadf8e653d service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.591804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d25a56-7390-4bdc-a883-4cbadf8e653d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.594794 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 809/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:31.596611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6db5d-7640-4b0a-b863-5205e94be01a service neutron] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.606674 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d25a56-7390-4bdc-a883-4cbadf8e653d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.608838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d25a56-7390-4bdc-a883-4cbadf8e653d service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.617871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6db5d-7640-4b0a-b863-5205e94be01a service neutron] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.623458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 808/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:31.624503 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d25a56-7390-4bdc-a883-4cbadf8e653d service neutron] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.631002 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1868-50b5-4aea-8c13-9a680a680652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.631930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1868-50b5-4aea-8c13-9a680a680652 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.632139 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1868-50b5-4aea-8c13-9a680a680652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.632508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1868-50b5-4aea-8c13-9a680a680652 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.636339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1868-50b5-4aea-8c13-9a680a680652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.637343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d25a56-7390-4bdc-a883-4cbadf8e653d service neutron] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.640423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1868-50b5-4aea-8c13-9a680a680652 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.643611 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b502f4-c2d5-4962-9123-1b60d24a360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.644527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b502f4-c2d5-4962-9123-1b60d24a360d admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.645000 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b502f4-c2d5-4962-9123-1b60d24a360d admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.645446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b502f4-c2d5-4962-9123-1b60d24a360d admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.646774 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b502f4-c2d5-4962-9123-1b60d24a360d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.650038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b502f4-c2d5-4962-9123-1b60d24a360d admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.679709 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 810/1618] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/users => generated 297 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:31.683724 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315eda-11b3-4f30-9787-5017ffd55c33 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.684468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315eda-11b3-4f30-9787-5017ffd55c33 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.684987 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315eda-11b3-4f30-9787-5017ffd55c33 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.692567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 811/1619] 10.222.0.13 () {54 vars in 961 bytes} [Wed May 25 13:50:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:31.693567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a315eda-11b3-4f30-9787-5017ffd55c33 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.696871 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 809/1620] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:31.697629 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b502f4-c2d5-4962-9123-1b60d24a360d admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.783333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a315eda-11b3-4f30-9787-5017ffd55c33 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.789588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08051d3b-aa5f-44dc-9e40-ccd1fa8b1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.790500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08051d3b-aa5f-44dc-9e40-ccd1fa8b1f96 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.791110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08051d3b-aa5f-44dc-9e40-ccd1fa8b1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.791738 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08051d3b-aa5f-44dc-9e40-ccd1fa8b1f96 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.792624 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08051d3b-aa5f-44dc-9e40-ccd1fa8b1f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.795815 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08051d3b-aa5f-44dc-9e40-ccd1fa8b1f96 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.827873 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 812/1621] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:31.834145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10059edf-4783-40a3-bcbe-b3d33a905833 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.834693 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10059edf-4783-40a3-bcbe-b3d33a905833 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.835411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10059edf-4783-40a3-bcbe-b3d33a905833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.863946 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-10059edf-4783-40a3-bcbe-b3d33a905833 None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:31.864948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b502f4-c2d5-4962-9123-1b60d24a360d admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.865317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-10059edf-4783-40a3-bcbe-b3d33a905833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:31.887407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbd37b-93b9-4790-adc5-724e32777222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.888349 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbd37b-93b9-4790-adc5-724e32777222 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.888718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbd37b-93b9-4790-adc5-724e32777222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.889098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbd37b-93b9-4790-adc5-724e32777222 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.890041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbd37b-93b9-4790-adc5-724e32777222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.892499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbd37b-93b9-4790-adc5-724e32777222 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.914724 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 810/1622] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:31.919583 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbd37b-93b9-4790-adc5-724e32777222 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.929781 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.937174 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbd37b-93b9-4790-adc5-724e32777222 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:31.945623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9edbb6-cbae-4417-8f08-d269f04e662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:31.946436 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9edbb6-cbae-4417-8f08-d269f04e662e admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:31.946804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9edbb6-cbae-4417-8f08-d269f04e662e admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:31.947161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9edbb6-cbae-4417-8f08-d269f04e662e admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:31.948043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9edbb6-cbae-4417-8f08-d269f04e662e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:31.950444 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9edbb6-cbae-4417-8f08-d269f04e662e admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:31.966102 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:31.986621 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 813/1623] 10.222.0.13 () {58 vars in 1058 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:31.990185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 811/1624] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:31 2022] POST /identity/v3/users => generated 293 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:31.991296 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9edbb6-cbae-4417-8f08-d269f04e662e admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:31.996776 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10059edf-4783-40a3-bcbe-b3d33a905833 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.011821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10059edf-4783-40a3-bcbe-b3d33a905833 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.017977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9edbb6-cbae-4417-8f08-d269f04e662e admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.021705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c22042-8740-4d61-b825-65168ba54a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.023024 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22042-8740-4d61-b825-65168ba54a6b admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.024140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22042-8740-4d61-b825-65168ba54a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.024628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22042-8740-4d61-b825-65168ba54a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.039974 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365551d-d4da-4e25-9068-42a56c06a7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.041031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365551d-d4da-4e25-9068-42a56c06a7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.041446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365551d-d4da-4e25-9068-42a56c06a7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.041893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365551d-d4da-4e25-9068-42a56c06a7f8 admin admin] PATH_INFO: `/v3/projects/190279d13e7a4301b9f570fbfe544f2b/users/3dd5f8356fb344a5b964f815654500c6/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.042757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22042-8740-4d61-b825-65168ba54a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.047162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22042-8740-4d61-b825-65168ba54a6b admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.096229 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365551d-d4da-4e25-9068-42a56c06a7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190279d13e7a4301b9f570fbfe544f2b, user_id=3dd5f8356fb344a5b964f815654500c6, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.099483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365551d-d4da-4e25-9068-42a56c06a7f8 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.100015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 814/1625] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:32.101043 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c22042-8740-4d61-b825-65168ba54a6b admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.132067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c22042-8740-4d61-b825-65168ba54a6b admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.139289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 812/1626] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:31 2022] PUT /identity/v3/projects/190279d13e7a4301b9f570fbfe544f2b/users/3dd5f8356fb344a5b964f815654500c6/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:32.143158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365551d-d4da-4e25-9068-42a56c06a7f8 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.280982 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8cb52-4875-4d5f-864b-5e79c6950be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.281922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8cb52-4875-4d5f-864b-5e79c6950be1 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.282317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8cb52-4875-4d5f-864b-5e79c6950be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.282909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8cb52-4875-4d5f-864b-5e79c6950be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.283895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8cb52-4875-4d5f-864b-5e79c6950be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.284107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365551d-d4da-4e25-9068-42a56c06a7f8 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.286963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8cb52-4875-4d5f-864b-5e79c6950be1 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.298873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad3b6d-3122-4588-abee-981a3a87c767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.299553 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad3b6d-3122-4588-abee-981a3a87c767 service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.299842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad3b6d-3122-4588-abee-981a3a87c767 service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.300122 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad3b6d-3122-4588-abee-981a3a87c767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.306764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 815/1627] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:32.310011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8cb52-4875-4d5f-864b-5e79c6950be1 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.322956 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8cb52-4875-4d5f-864b-5e79c6950be1 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.330234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d18f2-7bfd-43cc-8d03-faad8c3b5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.332866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d18f2-7bfd-43cc-8d03-faad8c3b5028 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.333185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d18f2-7bfd-43cc-8d03-faad8c3b5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.333484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d18f2-7bfd-43cc-8d03-faad8c3b5028 admin admin] PATH_INFO: `/v3/projects/e8725c3ce37e4bf8b9e0fddc64764bdc/users/6dc9d3322f1a4ceabfd9b70e6d1aa49a/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.352692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d18f2-7bfd-43cc-8d03-faad8c3b5028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8725c3ce37e4bf8b9e0fddc64764bdc, user_id=6dc9d3322f1a4ceabfd9b70e6d1aa49a, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.357468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d18f2-7bfd-43cc-8d03-faad8c3b5028 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.383155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 816/1628] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:32 2022] PUT /identity/v3/projects/e8725c3ce37e4bf8b9e0fddc64764bdc/users/6dc9d3322f1a4ceabfd9b70e6d1aa49a/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:32.384145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d18f2-7bfd-43cc-8d03-faad8c3b5028 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.434423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad3b6d-3122-4588-abee-981a3a87c767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.448274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad3b6d-3122-4588-abee-981a3a87c767 service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.466910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 813/1629] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:32.469549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d18f2-7bfd-43cc-8d03-faad8c3b5028 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.484442 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad3b6d-3122-4588-abee-981a3a87c767 service nova] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.488902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67810d13-4428-4fd3-85bd-b758f2f9d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.489975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810d13-4428-4fd3-85bd-b758f2f9d2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.492855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810d13-4428-4fd3-85bd-b758f2f9d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.495440 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810d13-4428-4fd3-85bd-b758f2f9d2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.496479 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67810d13-4428-4fd3-85bd-b758f2f9d2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.498697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67810d13-4428-4fd3-85bd-b758f2f9d2a4 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.516161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad3b6d-3122-4588-abee-981a3a87c767 service nova] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.528706 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 817/1630] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:32.532816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67810d13-4428-4fd3-85bd-b758f2f9d2a4 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.533262 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d3801-a149-4a7d-a8c0-fced9addaedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.538045 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d3801-a149-4a7d-a8c0-fced9addaedf admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.538521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d3801-a149-4a7d-a8c0-fced9addaedf admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.538917 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d3801-a149-4a7d-a8c0-fced9addaedf admin admin] PATH_INFO: `/v3/projects/92a4601c60614e5fb0d4ae6469effece/users/fb9b281300b7447598c0ce0077fcd77c/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.561528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67810d13-4428-4fd3-85bd-b758f2f9d2a4 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.571954 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bf896-9a73-4ab6-8127-4df042de1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.572785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bf896-9a73-4ab6-8127-4df042de1dab admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.573180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bf896-9a73-4ab6-8127-4df042de1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.574810 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bf896-9a73-4ab6-8127-4df042de1dab admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.577134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bf896-9a73-4ab6-8127-4df042de1dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.580766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bf896-9a73-4ab6-8127-4df042de1dab admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.582510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d3801-a149-4a7d-a8c0-fced9addaedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a4601c60614e5fb0d4ae6469effece, user_id=fb9b281300b7447598c0ce0077fcd77c, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.589820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d3801-a149-4a7d-a8c0-fced9addaedf admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.612383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 818/1631] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:32.613439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bf896-9a73-4ab6-8127-4df042de1dab admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.627410 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 814/1632] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:32 2022] PUT /identity/v3/projects/92a4601c60614e5fb0d4ae6469effece/users/fb9b281300b7447598c0ce0077fcd77c/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:32.628935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d3801-a149-4a7d-a8c0-fced9addaedf admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.638711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bf896-9a73-4ab6-8127-4df042de1dab admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.669494 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:32.753689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:32.779129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398c7ce-008c-4862-a173-ae48dadbafb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.781283 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c7ce-008c-4862-a173-ae48dadbafb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.782131 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c7ce-008c-4862-a173-ae48dadbafb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.783871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c7ce-008c-4862-a173-ae48dadbafb4 admin admin] PATH_INFO: `/v3/projects/190279d13e7a4301b9f570fbfe544f2b/users/3dd5f8356fb344a5b964f815654500c6/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.790073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398c7ce-008c-4862-a173-ae48dadbafb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190279d13e7a4301b9f570fbfe544f2b, user_id=3dd5f8356fb344a5b964f815654500c6, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.797552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d3801-a149-4a7d-a8c0-fced9addaedf admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:32.798436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398c7ce-008c-4862-a173-ae48dadbafb4 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.807844 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9234a-13f7-482e-80b2-4e76bcfe288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:32.809245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9234a-13f7-482e-80b2-4e76bcfe288f admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.809859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9234a-13f7-482e-80b2-4e76bcfe288f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.810362 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9234a-13f7-482e-80b2-4e76bcfe288f admin admin] PATH_INFO: `/v3/projects/e8725c3ce37e4bf8b9e0fddc64764bdc/users/6dc9d3322f1a4ceabfd9b70e6d1aa49a/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.813203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9234a-13f7-482e-80b2-4e76bcfe288f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8725c3ce37e4bf8b9e0fddc64764bdc, user_id=6dc9d3322f1a4ceabfd9b70e6d1aa49a, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:32.816754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9234a-13f7-482e-80b2-4e76bcfe288f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:32.833460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 819/1633] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:32 2022] PUT /identity/v3/projects/190279d13e7a4301b9f570fbfe544f2b/users/3dd5f8356fb344a5b964f815654500c6/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:32.833460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398c7ce-008c-4862-a173-ae48dadbafb4 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:32.853782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 815/1634] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:32 2022] PUT /identity/v3/projects/e8725c3ce37e4bf8b9e0fddc64764bdc/users/6dc9d3322f1a4ceabfd9b70e6d1aa49a/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:32.853782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836206f-fbf2-48c9-a130-f64b740a12f0 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:32.853782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836206f-fbf2-48c9-a130-f64b740a12f0 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:32.853782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836206f-fbf2-48c9-a130-f64b740a12f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:32.930386 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b836206f-fbf2-48c9-a130-f64b740a12f0 None None] MFA Rules not processed for user `3dd5f8356fb344a5b964f815654500c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:32.931979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b836206f-fbf2-48c9-a130-f64b740a12f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:32.989164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398c7ce-008c-4862-a173-ae48dadbafb4 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:33.089218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5f3f2-1fe4-4621-a9df-cd3d4372e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:33.090409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f3f2-1fe4-4621-a9df-cd3d4372e6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.090895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f3f2-1fe4-4621-a9df-cd3d4372e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.091319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5f3f2-1fe4-4621-a9df-cd3d4372e6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.093405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5f3f2-1fe4-4621-a9df-cd3d4372e6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:33.095414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5f3f2-1fe4-4621-a9df-cd3d4372e6d7 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:33.102655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 816/1635] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:33.104884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa394-8c44-4930-a7da-a908a8b55140 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.105372 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa394-8c44-4930-a7da-a908a8b55140 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.105860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fa394-8c44-4930-a7da-a908a8b55140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.113104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 820/1636] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:33.113104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fedda-588e-4800-ae31-2dee4f5c5603 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.113104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fedda-588e-4800-ae31-2dee4f5c5603 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.113104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fedda-588e-4800-ae31-2dee4f5c5603 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.115053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 821/1637] 10.222.0.13 () {54 vars in 912 bytes} [Wed May 25 13:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:33.115825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fedda-588e-4800-ae31-2dee4f5c5603 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:33.138341 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fedda-588e-4800-ae31-2dee4f5c5603 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:33.155475 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b04fa394-8c44-4930-a7da-a908a8b55140 None None] MFA Rules not processed for user `6dc9d3322f1a4ceabfd9b70e6d1aa49a`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:33.157203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f99cbd-2259-459f-a732-cc9f90bc99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:33.158262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99cbd-2259-459f-a732-cc9f90bc99f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.158655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99cbd-2259-459f-a732-cc9f90bc99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.159073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99cbd-2259-459f-a732-cc9f90bc99f0 admin admin] PATH_INFO: `/v3/projects/92a4601c60614e5fb0d4ae6469effece/users/fb9b281300b7447598c0ce0077fcd77c/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.161932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f99cbd-2259-459f-a732-cc9f90bc99f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a4601c60614e5fb0d4ae6469effece, user_id=fb9b281300b7447598c0ce0077fcd77c, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:33.167383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f99cbd-2259-459f-a732-cc9f90bc99f0 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:33.173129 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b04fa394-8c44-4930-a7da-a908a8b55140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:33.196321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 822/1638] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:33 2022] PUT /identity/v3/projects/92a4601c60614e5fb0d4ae6469effece/users/fb9b281300b7447598c0ce0077fcd77c/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:33.196321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f99cbd-2259-459f-a732-cc9f90bc99f0 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:33.325654 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:33.347050 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f99cbd-2259-459f-a732-cc9f90bc99f0 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:33.355312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3e7b5-8e7f-41bd-bf8a-7b41297ef694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:33.355997 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e7b5-8e7f-41bd-bf8a-7b41297ef694 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.356288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e7b5-8e7f-41bd-bf8a-7b41297ef694 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.356570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e7b5-8e7f-41bd-bf8a-7b41297ef694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.376218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 817/1639] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:33.378726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53fc08-78b5-479f-93be-bc5fc80a100c None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.379008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53fc08-78b5-479f-93be-bc5fc80a100c None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.379321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53fc08-78b5-479f-93be-bc5fc80a100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.428095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-eb53fc08-78b5-479f-93be-bc5fc80a100c None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:33.429918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-eb53fc08-78b5-479f-93be-bc5fc80a100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:33.500942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:33.511089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3e7b5-8e7f-41bd-bf8a-7b41297ef694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:33.512541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3e7b5-8e7f-41bd-bf8a-7b41297ef694 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:33.526039 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 823/1640] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:33.528074 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d5a1-bfb4-488a-82a5-235d71a7d591 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.529337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d5a1-bfb4-488a-82a5-235d71a7d591 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.529712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d5a1-bfb4-488a-82a5-235d71a7d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.544088 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 818/1641] 10.222.0.13 () {58 vars in 1009 bytes} [Wed May 25 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:33.545464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53fc08-78b5-479f-93be-bc5fc80a100c None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:33.558314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53fc08-78b5-479f-93be-bc5fc80a100c None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:33.565783 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2e347-bdd3-46fe-a810-0c40e3982316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:33.566654 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e347-bdd3-46fe-a810-0c40e3982316 service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.567051 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e347-bdd3-46fe-a810-0c40e3982316 service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.567708 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e347-bdd3-46fe-a810-0c40e3982316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.596436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-43d1d5a1-bfb4-488a-82a5-235d71a7d591 None None] MFA Rules not processed for user `fb9b281300b7447598c0ce0077fcd77c`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:33.599418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2e347-bdd3-46fe-a810-0c40e3982316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:33.599998 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-43d1d5a1-bfb4-488a-82a5-235d71a7d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:33.603136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2e347-bdd3-46fe-a810-0c40e3982316 service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:33.628490 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 819/1642] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:33.631339 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b594f-7763-44b4-a30b-a7961266e262 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.631954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b594f-7763-44b4-a30b-a7961266e262 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.632444 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b594f-7763-44b4-a30b-a7961266e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.668792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b93b594f-7763-44b4-a30b-a7961266e262 None None] MFA Rules not processed for user `e1ccb7ed06164e6592dae890f5d6fbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:33.671197 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b93b594f-7763-44b4-a30b-a7961266e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:33.706093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 824/1643] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:33.707353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d5a1-bfb4-488a-82a5-235d71a7d591 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:33.739149 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d5a1-bfb4-488a-82a5-235d71a7d591 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:33.753440 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478f9a4-02da-4db8-91fd-70d3ceb4d9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:33.754335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478f9a4-02da-4db8-91fd-70d3ceb4d9ee service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.754626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478f9a4-02da-4db8-91fd-70d3ceb4d9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.754911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478f9a4-02da-4db8-91fd-70d3ceb4d9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.782113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478f9a4-02da-4db8-91fd-70d3ceb4d9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:33.784434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478f9a4-02da-4db8-91fd-70d3ceb4d9ee service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:33.801646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 825/1644] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:33.837386 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 820/1645] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:33.851019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478f9a4-02da-4db8-91fd-70d3ceb4d9ee service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:33.852469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c2d68-79d4-467a-9583-f46a79188ebd None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.852783 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c2d68-79d4-467a-9583-f46a79188ebd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.853074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c2d68-79d4-467a-9583-f46a79188ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.861902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478f9a4-02da-4db8-91fd-70d3ceb4d9ee service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:33.868477 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771ae20-eaa2-433c-b1b6-e826f918d5f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:33.869239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771ae20-eaa2-433c-b1b6-e826f918d5f1 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.869529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771ae20-eaa2-433c-b1b6-e826f918d5f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.869883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771ae20-eaa2-433c-b1b6-e826f918d5f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.882166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771ae20-eaa2-433c-b1b6-e826f918d5f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:33.882462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-0c9c2d68-79d4-467a-9583-f46a79188ebd None None] MFA Rules not processed for user `e1ccb7ed06164e6592dae890f5d6fbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:33.884281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771ae20-eaa2-433c-b1b6-e826f918d5f1 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:33.885149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-0c9c2d68-79d4-467a-9583-f46a79188ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:33.894440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 821/1646] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:33.901847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 826/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:33.925313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faba63-5b62-4b21-ae02-3de84a2080b5 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.925896 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faba63-5b62-4b21-ae02-3de84a2080b5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.926424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faba63-5b62-4b21-ae02-3de84a2080b5 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.929323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 822/1648] 10.222.0.13 () {54 vars in 961 bytes} [Wed May 25 13:50:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:33.940802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1079-d420-4256-bc52-ca0e792e3f0e None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:33.941230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1079-d420-4256-bc52-ca0e792e3f0e None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:33.941586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1079-d420-4256-bc52-ca0e792e3f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:33.995474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faba63-5b62-4b21-ae02-3de84a2080b5 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:34.000302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-435d1079-d420-4256-bc52-ca0e792e3f0e None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:34.003436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-435d1079-d420-4256-bc52-ca0e792e3f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:34.012594 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faba63-5b62-4b21-ae02-3de84a2080b5 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:34.022875 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3ae6a-f1fe-46f7-b982-03b18da9f7e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:34.023712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ae6a-f1fe-46f7-b982-03b18da9f7e8 service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.024081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ae6a-f1fe-46f7-b982-03b18da9f7e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.024439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ae6a-f1fe-46f7-b982-03b18da9f7e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.025938 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 827/1649] 10.222.0.13 () {58 vars in 1058 bytes} [Wed May 25 13:50:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:34.027089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d1079-d420-4256-bc52-ca0e792e3f0e None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:34.039802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d1079-d420-4256-bc52-ca0e792e3f0e None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:34.047634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbd52d-3723-48b7-92ae-d676f9ee6cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:34.048322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbd52d-3723-48b7-92ae-d676f9ee6cef service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.048609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbd52d-3723-48b7-92ae-d676f9ee6cef service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.048889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbd52d-3723-48b7-92ae-d676f9ee6cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.061561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbd52d-3723-48b7-92ae-d676f9ee6cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:34.063458 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbd52d-3723-48b7-92ae-d676f9ee6cef service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:34.110376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 828/1650] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:34.171729 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3ae6a-f1fe-46f7-b982-03b18da9f7e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:34.174616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3ae6a-f1fe-46f7-b982-03b18da9f7e8 service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:34.214778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 823/1651] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:34.558549 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005a79-7f94-4cac-9247-c0c4c158c53b None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.558983 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005a79-7f94-4cac-9247-c0c4c158c53b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.560076 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005a79-7f94-4cac-9247-c0c4c158c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.670440 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-ae005a79-7f94-4cac-9247-c0c4c158c53b None None] MFA Rules not processed for user `075509b1fe844621ad01c9330fbd1657`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:34.674240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-ae005a79-7f94-4cac-9247-c0c4c158c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:34.764361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:34.861798 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840605f-3b33-4967-8f05-78215f58f41d None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.862398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840605f-3b33-4967-8f05-78215f58f41d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.862661 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840605f-3b33-4967-8f05-78215f58f41d None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.866681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 824/1652] 10.222.0.13 () {54 vars in 912 bytes} [Wed May 25 13:50:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:50:34.884050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb77c81-ceb3-43b4-aa04-6580ce641a3d None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:34.884559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb77c81-ceb3-43b4-aa04-6580ce641a3d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:34.885058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb77c81-ceb3-43b4-aa04-6580ce641a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:34.918668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 829/1653] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:34.921287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-ecb77c81-ceb3-43b4-aa04-6580ce641a3d None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:34.923277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ecb77c81-ceb3-43b4-aa04-6580ce641a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:34.924127 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae005a79-7f94-4cac-9247-c0c4c158c53b None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:34.950956 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 825/1654] 10.222.0.13 () {58 vars in 1009 bytes} [Wed May 25 13:50:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:34.963073 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb77c81-ceb3-43b4-aa04-6580ce641a3d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:34.971650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ecb77c81-ceb3-43b4-aa04-6580ce641a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:35.096638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:35.133686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb77c81-ceb3-43b4-aa04-6580ce641a3d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.137260 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae005a79-7f94-4cac-9247-c0c4c158c53b None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.147104 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d075045-c579-4369-8fcb-1b522db70540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.147802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d075045-c579-4369-8fcb-1b522db70540 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.148806 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d075045-c579-4369-8fcb-1b522db70540 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.149110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d075045-c579-4369-8fcb-1b522db70540 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.149848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d075045-c579-4369-8fcb-1b522db70540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.151796 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d075045-c579-4369-8fcb-1b522db70540 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.155840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe543f-9859-41a9-b1b0-e12ad783075f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc89b93f03e453da2780d75216e0566', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.156523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe543f-9859-41a9-b1b0-e12ad783075f service glance] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.156865 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe543f-9859-41a9-b1b0-e12ad783075f service glance] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.157155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe543f-9859-41a9-b1b0-e12ad783075f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.181389 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe543f-9859-41a9-b1b0-e12ad783075f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.185292 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe543f-9859-41a9-b1b0-e12ad783075f service glance] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.212495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 830/1655] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:34 2022] POST /identity/v3/projects => generated 405 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:50:35.216227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d075045-c579-4369-8fcb-1b522db70540 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.226335 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 826/1656] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:35.230199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe543f-9859-41a9-b1b0-e12ad783075f service glance] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.263096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe543f-9859-41a9-b1b0-e12ad783075f service glance] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.388105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d075045-c579-4369-8fcb-1b522db70540 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.413393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da0afb-efad-4cea-8e2c-5ff948678574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.414230 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0afb-efad-4cea-8e2c-5ff948678574 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.414525 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0afb-efad-4cea-8e2c-5ff948678574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.414902 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0afb-efad-4cea-8e2c-5ff948678574 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.415555 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da0afb-efad-4cea-8e2c-5ff948678574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.418063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da0afb-efad-4cea-8e2c-5ff948678574 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.461604 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab164e-e190-4149-810f-a62bdd261a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.462596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab164e-e190-4149-810f-a62bdd261a8f service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.463187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab164e-e190-4149-810f-a62bdd261a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.465052 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab164e-e190-4149-810f-a62bdd261a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.471257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 831/1657] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:35 2022] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:50:35.475814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da0afb-efad-4cea-8e2c-5ff948678574 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.498734 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da0afb-efad-4cea-8e2c-5ff948678574 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.524775 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355481-2d5a-4050-ab93-38e76e94271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.525481 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355481-2d5a-4050-ab93-38e76e94271c admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.527455 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355481-2d5a-4050-ab93-38e76e94271c admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.527751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355481-2d5a-4050-ab93-38e76e94271c admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.530768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79355481-2d5a-4050-ab93-38e76e94271c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.537572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79355481-2d5a-4050-ab93-38e76e94271c admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.595653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 832/1658] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:35.596888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355481-2d5a-4050-ab93-38e76e94271c admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.615895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab164e-e190-4149-810f-a62bdd261a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.618004 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab164e-e190-4149-810f-a62bdd261a8f service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.636072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 827/1659] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:35.638113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355481-2d5a-4050-ab93-38e76e94271c admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.646051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ee705-9d8b-4d0e-b6dd-a69467229ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.647463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee705-9d8b-4d0e-b6dd-a69467229ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.648034 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee705-9d8b-4d0e-b6dd-a69467229ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.648567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ee705-9d8b-4d0e-b6dd-a69467229ac2 admin admin] PATH_INFO: `/v3/projects/2c3be95cb6cf43e48d742160f322c42d/users/acc1e668ef6547bd9426446f44e9abdc/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.675215 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab164e-e190-4149-810f-a62bdd261a8f service cinder] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.693295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab164e-e190-4149-810f-a62bdd261a8f service cinder] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.704079 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ee705-9d8b-4d0e-b6dd-a69467229ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be95cb6cf43e48d742160f322c42d, user_id=acc1e668ef6547bd9426446f44e9abdc, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.716235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fea53-f6f0-423b-9319-4db7c915b3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.719202 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fea53-f6f0-423b-9319-4db7c915b3ce service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.719502 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fea53-f6f0-423b-9319-4db7c915b3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.721006 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ee705-9d8b-4d0e-b6dd-a69467229ac2 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.723958 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fea53-f6f0-423b-9319-4db7c915b3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.756969 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 833/1660] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:35 2022] PUT /identity/v3/projects/2c3be95cb6cf43e48d742160f322c42d/users/acc1e668ef6547bd9426446f44e9abdc/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:35.758786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ee705-9d8b-4d0e-b6dd-a69467229ac2 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.767186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:35.905403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fea53-f6f0-423b-9319-4db7c915b3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.909210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fea53-f6f0-423b-9319-4db7c915b3ce service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.938357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 828/1661] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:50:35.939361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ee705-9d8b-4d0e-b6dd-a69467229ac2 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:35.945968 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1e2dd-f09a-46cb-b9aa-e6d7e0ba018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:35.946694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1e2dd-f09a-46cb-b9aa-e6d7e0ba018a admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:35.947138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1e2dd-f09a-46cb-b9aa-e6d7e0ba018a admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:35.947495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1e2dd-f09a-46cb-b9aa-e6d7e0ba018a admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:35.948445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1e2dd-f09a-46cb-b9aa-e6d7e0ba018a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:35.950319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1e2dd-f09a-46cb-b9aa-e6d7e0ba018a admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:35.968704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 834/1662] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:35.973489 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fea53-f6f0-423b-9319-4db7c915b3ce service cinder] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:35.998569 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fea53-f6f0-423b-9319-4db7c915b3ce service cinder] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.024236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a8a72-2261-4bef-849e-d7b726aaa501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.052936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8a72-2261-4bef-849e-d7b726aaa501 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.052936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8a72-2261-4bef-849e-d7b726aaa501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.052936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8a72-2261-4bef-849e-d7b726aaa501 admin admin] PATH_INFO: `/v3/projects/2c3be95cb6cf43e48d742160f322c42d/users/acc1e668ef6547bd9426446f44e9abdc/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.052936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a8a72-2261-4bef-849e-d7b726aaa501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be95cb6cf43e48d742160f322c42d, user_id=acc1e668ef6547bd9426446f44e9abdc, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:36.052936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a8a72-2261-4bef-849e-d7b726aaa501 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:36.077076 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 829/1663] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:35 2022] PUT /identity/v3/projects/2c3be95cb6cf43e48d742160f322c42d/users/acc1e668ef6547bd9426446f44e9abdc/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:36.654388 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71933e-690b-4f05-910c-09f0a3c5ba17 None None] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.654691 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71933e-690b-4f05-910c-09f0a3c5ba17 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.655018 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71933e-690b-4f05-910c-09f0a3c5ba17 None None] PATH_INFO: `/` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.657034 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 835/1664] 10.222.0.13 () {54 vars in 912 bytes} [Wed May 25 13:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:36.662695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc378f-acc4-4e90-980f-a223a991eb60 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.662987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc378f-acc4-4e90-980f-a223a991eb60 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.663277 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc378f-acc4-4e90-980f-a223a991eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.760740 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b6dc378f-acc4-4e90-980f-a223a991eb60 None None] MFA Rules not processed for user `5d7bc855c20b431b9aabaee20101b79c`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:36.762504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b6dc378f-acc4-4e90-980f-a223a991eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:36.791114 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:36.914597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 830/1665] 10.222.0.13 () {58 vars in 1009 bytes} [Wed May 25 13:50:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:36.936452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71933e-690b-4f05-910c-09f0a3c5ba17 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:36.956495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71933e-690b-4f05-910c-09f0a3c5ba17 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:36.962722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c22c81-3ffc-4d95-92fe-d94957c3d380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:36.963637 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22c81-3ffc-4d95-92fe-d94957c3d380 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:36.964162 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22c81-3ffc-4d95-92fe-d94957c3d380 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:36.964638 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22c81-3ffc-4d95-92fe-d94957c3d380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:36.985081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c22c81-3ffc-4d95-92fe-d94957c3d380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:36.986914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c22c81-3ffc-4d95-92fe-d94957c3d380 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:37.005766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 836/1666] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:39.043678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88da5-c545-40cd-91bc-944ab252d452 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.044175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88da5-c545-40cd-91bc-944ab252d452 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.044266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88da5-c545-40cd-91bc-944ab252d452 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.045639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 831/1667] 10.222.0.13 () {54 vars in 960 bytes} [Wed May 25 13:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:39.052125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2a46-f225-439a-a8dc-ec0925c42141 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.055635 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2a46-f225-439a-a8dc-ec0925c42141 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.056744 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb2a46-f225-439a-a8dc-ec0925c42141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.095572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-89fb2a46-f225-439a-a8dc-ec0925c42141 None None] MFA Rules not processed for user `ba5bb1004bdc4e74809cc8e43b5d9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:39.098012 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-89fb2a46-f225-439a-a8dc-ec0925c42141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:39.251375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 837/1668] 10.222.0.13 () {58 vars in 1057 bytes} [Wed May 25 13:50:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:39.259497 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f88da5-c545-40cd-91bc-944ab252d452 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:39.281426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f88da5-c545-40cd-91bc-944ab252d452 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:39.298363 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba5bb1004bdc4e74809cc8e43b5d9e16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:39.299142 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.299529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.299881 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.307932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:39.328036 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:39.333261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:39.362132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 832/1669] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:39.619751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8532e-7517-4a27-8c8e-f5aeb286647f None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:39.620167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8532e-7517-4a27-8c8e-f5aeb286647f None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:39.621346 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8532e-7517-4a27-8c8e-f5aeb286647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:39.704460 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-0bf8532e-7517-4a27-8c8e-f5aeb286647f None None] MFA Rules not processed for user `acc1e668ef6547bd9426446f44e9abdc`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:39.706004 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-0bf8532e-7517-4a27-8c8e-f5aeb286647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:39.906988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 838/1670] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:39 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:40.014960 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:40.242341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850566-ebd2-46a6-a69a-e3cf11a016c1 service placement] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:40.263580 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:40.264794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.265240 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.266345 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] PATH_INFO: `/v3/users/ad7e41008d2f4502b13938e0a9ba79de` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.268538 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7e41008d2f4502b13938e0a9ba79de)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:40.271627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54636a-3d22-4f45-b35b-7d6f97c6d761 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.274179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54636a-3d22-4f45-b35b-7d6f97c6d761 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.274674 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54636a-3d22-4f45-b35b-7d6f97c6d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.283667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: WARNING py.warnings [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:50:40.283667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: warnings.warn(msg) May 25 13:50:40.283667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: May 25 13:50:40.291770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:40.302418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:40.361284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-5b54636a-3d22-4f45-b35b-7d6f97c6d761 None None] MFA Rules not processed for user `6f66a907c810404aa8e2edfffaffc608`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:40.366530 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-5b54636a-3d22-4f45-b35b-7d6f97c6d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:40.548087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7e41008d2f4502b13938e0a9ba79de'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:40.582731 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7e41008d2f4502b13938e0a9ba79de'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:40.625777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 839/1671] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:40.641282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54636a-3d22-4f45-b35b-7d6f97c6d761 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:40.646984 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7e41008d2f4502b13938e0a9ba79de'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:40.653330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7e41008d2f4502b13938e0a9ba79de'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:40.671986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-abe68dc2-2d8f-4a66-9ea0-4b3855647dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7e41008d2f4502b13938e0a9ba79de'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:40.682238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 833/1672] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:50:40 2022] DELETE /identity/v3/users/ad7e41008d2f4502b13938e0a9ba79de => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:40.687558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f5e-7905-46d6-86b9-8f07ac735614 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.688406 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f5e-7905-46d6-86b9-8f07ac735614 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.688406 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f5e-7905-46d6-86b9-8f07ac735614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.731556 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-997a6f5e-7905-46d6-86b9-8f07ac735614 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:40.732652 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-997a6f5e-7905-46d6-86b9-8f07ac735614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:40.798083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:40.821900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54636a-3d22-4f45-b35b-7d6f97c6d761 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:40.912749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 834/1673] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:40.926985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6f5e-7905-46d6-86b9-8f07ac735614 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:40.930449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-997a6f5e-7905-46d6-86b9-8f07ac735614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:40.935110 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838970a5-de72-42cd-ad56-ca03da63ebef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:40.936389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838970a5-de72-42cd-ad56-ca03da63ebef service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:40.936968 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838970a5-de72-42cd-ad56-ca03da63ebef service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:40.950842 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838970a5-de72-42cd-ad56-ca03da63ebef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:40.956766 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-838970a5-de72-42cd-ad56-ca03da63ebef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:41.042310 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:41.047005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6f5e-7905-46d6-86b9-8f07ac735614 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:41.053266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9901bc-c866-4d97-be5c-cdf9f48a2246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:41.054951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9901bc-c866-4d97-be5c-cdf9f48a2246 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.056011 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9901bc-c866-4d97-be5c-cdf9f48a2246 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.056775 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9901bc-c866-4d97-be5c-cdf9f48a2246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.074035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9901bc-c866-4d97-be5c-cdf9f48a2246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:41.081393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9901bc-c866-4d97-be5c-cdf9f48a2246 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:41.102197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838970a5-de72-42cd-ad56-ca03da63ebef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:41.116347 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838970a5-de72-42cd-ad56-ca03da63ebef service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:41.125550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 835/1674] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:41.142139 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 840/1675] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:41.719862 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1e2fa-351b-4186-9cd8-e12a76b8877d None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.720840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1e2fa-351b-4186-9cd8-e12a76b8877d None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.721319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1e2fa-351b-4186-9cd8-e12a76b8877d None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.723477 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 836/1676] 10.222.0.13 () {54 vars in 921 bytes} [Wed May 25 13:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:41.761474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ed2da-1d9d-4f0f-bcae-2e6b0be120ee None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.762207 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ed2da-1d9d-4f0f-bcae-2e6b0be120ee None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.762558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ed2da-1d9d-4f0f-bcae-2e6b0be120ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.813939 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b64ed2da-1d9d-4f0f-bcae-2e6b0be120ee None None] MFA Rules not processed for user `ba5bb1004bdc4e74809cc8e43b5d9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:41.826586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b64ed2da-1d9d-4f0f-bcae-2e6b0be120ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:41.834453 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1e2fa-351b-4186-9cd8-e12a76b8877d None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:41.837705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-46f1e2fa-351b-4186-9cd8-e12a76b8877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:41.879394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1e2fa-351b-4186-9cd8-e12a76b8877d None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:41.896059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:41.897126 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:41.897489 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:41.899188 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] PATH_INFO: `/v3/projects/ebe9dd3b6cf64559953f69c0d9b5d074` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:41.899812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe9dd3b6cf64559953f69c0d9b5d074)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:41.906077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:42.022260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe9dd3b6cf64559953f69c0d9b5d074', 'request_id': 'req-b7495142-1682-4d45-b809-b03ef13d35f3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.035996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe9dd3b6cf64559953f69c0d9b5d074', 'request_id': 'req-b7495142-1682-4d45-b809-b03ef13d35f3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.046913 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 841/1677] 10.222.0.13 () {58 vars in 1018 bytes} [Wed May 25 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:42.056029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe9dd3b6cf64559953f69c0d9b5d074', 'request_id': 'req-b7495142-1682-4d45-b809-b03ef13d35f3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.093689 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ed2da-1d9d-4f0f-bcae-2e6b0be120ee None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:42.096268 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b64ed2da-1d9d-4f0f-bcae-2e6b0be120ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:42.097808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] The token cache is being invalidate because project ebe9dd3b6cf64559953f69c0d9b5d074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:50:42.101107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.102893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.107371 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 837/1678] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:41 2022] DELETE /identity/v3/projects/ebe9dd3b6cf64559953f69c0d9b5d074 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:50:42.111368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:42.118980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:42.163474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ed2da-1d9d-4f0f-bcae-2e6b0be120ee None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:42.330823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:42.352985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495142-1682-4d45-b809-b03ef13d35f3 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:42.362741 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:42.364750 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.365901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.366401 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] PATH_INFO: `/v3/users/6dc9d3322f1a4ceabfd9b70e6d1aa49a` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.369656 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc9d3322f1a4ceabfd9b70e6d1aa49a)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:42.375238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:42.474930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc9d3322f1a4ceabfd9b70e6d1aa49a'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.490769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc9d3322f1a4ceabfd9b70e6d1aa49a'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.527284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc9d3322f1a4ceabfd9b70e6d1aa49a'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.528578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc9d3322f1a4ceabfd9b70e6d1aa49a'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.553148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc9d3322f1a4ceabfd9b70e6d1aa49a'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:42.566710 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 838/1679] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:50:42 2022] DELETE /identity/v3/users/6dc9d3322f1a4ceabfd9b70e6d1aa49a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:42.641391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6cbe3-678c-4ba8-8707-7eb37bfd1f87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba5bb1004bdc4e74809cc8e43b5d9e16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:42.643007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cbe3-678c-4ba8-8707-7eb37bfd1f87 service placement] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:42.643958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cbe3-678c-4ba8-8707-7eb37bfd1f87 service placement] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:42.644530 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cbe3-678c-4ba8-8707-7eb37bfd1f87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:42.648040 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-78a6cbe3-678c-4ba8-8707-7eb37bfd1f87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:42.667131 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6cbe3-678c-4ba8-8707-7eb37bfd1f87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:42.669345 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6cbe3-678c-4ba8-8707-7eb37bfd1f87 service placement] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:42.703817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 842/1680] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:50:43.142640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.144242 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:43.237251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cca2b-69a8-4ae4-bbe7-935c97d9a6f8 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.244228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.245637 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.246135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.246609 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] PATH_INFO: `/v3/projects/e8725c3ce37e4bf8b9e0fddc64764bdc` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.248218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8725c3ce37e4bf8b9e0fddc64764bdc)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.250546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:43.348818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8725c3ce37e4bf8b9e0fddc64764bdc', 'request_id': 'req-c0493400-4c70-4dcc-b616-369798993577'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:43.365434 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8725c3ce37e4bf8b9e0fddc64764bdc', 'request_id': 'req-c0493400-4c70-4dcc-b616-369798993577'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:43.385110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8725c3ce37e4bf8b9e0fddc64764bdc', 'request_id': 'req-c0493400-4c70-4dcc-b616-369798993577'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:43.413332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] The token cache is being invalidate because project e8725c3ce37e4bf8b9e0fddc64764bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:50:43.413848 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:43.415412 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:43.420067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 839/1681] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:43 2022] DELETE /identity/v3/projects/e8725c3ce37e4bf8b9e0fddc64764bdc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:43.425244 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458540-7d9f-448b-83b4-c0d163ece876 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.434234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458540-7d9f-448b-83b4-c0d163ece876 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.434725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458540-7d9f-448b-83b4-c0d163ece876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.516652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-50458540-7d9f-448b-83b4-c0d163ece876 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:43.517777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-50458540-7d9f-448b-83b4-c0d163ece876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:43.629026 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.631429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:43.652815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:43.693188 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:43.744001 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 843/1682] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:43.748577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279899f7-eb29-472a-a966-63f68b0159d6 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.748837 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279899f7-eb29-472a-a966-63f68b0159d6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.749122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279899f7-eb29-472a-a966-63f68b0159d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.829198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0493400-4c70-4dcc-b616-369798993577 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.832641 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-279899f7-eb29-472a-a966-63f68b0159d6 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:43.835063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-279899f7-eb29-472a-a966-63f68b0159d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:43.837021 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.838813 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.839317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.839787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] PATH_INFO: `/v3/users/075509b1fe844621ad01c9330fbd1657` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.852337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=075509b1fe844621ad01c9330fbd1657)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.865137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:43.865326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 844/1683] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:43.899439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279899f7-eb29-472a-a966-63f68b0159d6 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:43.943776 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279899f7-eb29-472a-a966-63f68b0159d6 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:43.967550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:43.968648 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:43.969113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:43.969747 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:43.971138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:43.971695 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:43.975617 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.006188 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 845/1684] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:44.013963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.030830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e86ce5-ab86-4f74-a89a-6dd047342383 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:44.037688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68fad0-0446-43f8-b04e-4029ed7a1f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:44.039310 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68fad0-0446-43f8-b04e-4029ed7a1f72 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.039883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68fad0-0446-43f8-b04e-4029ed7a1f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.040257 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68fad0-0446-43f8-b04e-4029ed7a1f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.041060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68fad0-0446-43f8-b04e-4029ed7a1f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.043228 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68fad0-0446-43f8-b04e-4029ed7a1f72 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.058476 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075509b1fe844621ad01c9330fbd1657'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.083462 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075509b1fe844621ad01c9330fbd1657'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.114146 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 846/1685] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:44 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:44.129241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68fad0-0446-43f8-b04e-4029ed7a1f72 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.139731 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075509b1fe844621ad01c9330fbd1657'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.141260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075509b1fe844621ad01c9330fbd1657'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.163181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075509b1fe844621ad01c9330fbd1657'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.183737 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 840/1686] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:50:43 2022] DELETE /identity/v3/users/075509b1fe844621ad01c9330fbd1657 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:44.334109 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68fad0-0446-43f8-b04e-4029ed7a1f72 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:44.458833 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e9dc-99fa-4752-8a7b-8becb90b8757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:44.461100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e9dc-99fa-4752-8a7b-8becb90b8757 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.461533 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e9dc-99fa-4752-8a7b-8becb90b8757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.462016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e9dc-99fa-4752-8a7b-8becb90b8757 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.462868 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e9dc-99fa-4752-8a7b-8becb90b8757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.465137 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e9dc-99fa-4752-8a7b-8becb90b8757 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.527095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 847/1687] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:44 2022] POST /identity/v3/users => generated 291 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:44.529942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.535802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:44.574881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dadb22-a99b-4603-8cc7-379d4339235a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.575548 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dadb22-a99b-4603-8cc7-379d4339235a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.576102 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dadb22-a99b-4603-8cc7-379d4339235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.591782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a424-22fa-457f-8979-94ae135dc8cc admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:44.628380 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:44.629145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.629441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.629749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.630607 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.634601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.651109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 841/1688] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:44.652234 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.654825 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:44.668976 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-63dadb22-a99b-4603-8cc7-379d4339235a None None] MFA Rules not processed for user `04e1c5462d614e1cb1153fa28c901a04`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:44.670275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-63dadb22-a99b-4603-8cc7-379d4339235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:44.670778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b70e90-4048-411c-9c53-456c1592859e admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:44.691804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:44.692820 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:44.693172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:44.693529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] PATH_INFO: `/v3/projects/bb1c59e24deb4fca9ac689298bcaa6dc` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:44.696937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1c59e24deb4fca9ac689298bcaa6dc)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:44.699552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:44.790980 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1c59e24deb4fca9ac689298bcaa6dc', 'request_id': 'req-31164105-b341-4b63-b35c-4de8d3ce3b23'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.800808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1c59e24deb4fca9ac689298bcaa6dc', 'request_id': 'req-31164105-b341-4b63-b35c-4de8d3ce3b23'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.810644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1c59e24deb4fca9ac689298bcaa6dc', 'request_id': 'req-31164105-b341-4b63-b35c-4de8d3ce3b23'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.814134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:44.834593 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] The token cache is being invalidate because project bb1c59e24deb4fca9ac689298bcaa6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:50:44.836198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.837517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:44.840335 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 842/1689] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:44 2022] DELETE /identity/v3/projects/bb1c59e24deb4fca9ac689298bcaa6dc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:44.843378 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.843738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:44.854422 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:44.927247 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 848/1690] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:44.928254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dadb22-a99b-4603-8cc7-379d4339235a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:44.929854 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-63dadb22-a99b-4603-8cc7-379d4339235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:44.946117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dadb22-a99b-4603-8cc7-379d4339235a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.030053 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31164105-b341-4b63-b35c-4de8d3ce3b23 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.036833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.037548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.037878 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.038862 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.039621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.041331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.072824 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 843/1691] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:45.072824 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.074452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:45.110108 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.111018 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.111308 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.111596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] PATH_INFO: `/v3/users/acc1e668ef6547bd9426446f44e9abdc` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.113400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc1e668ef6547bd9426446f44e9abdc)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.118931 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.243635 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c53733-08e1-46b8-8641-74703f53bc2a admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.257120 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be8c88-8c80-4e9b-97cd-2b84d784ee2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.260246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be8c88-8c80-4e9b-97cd-2b84d784ee2c service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.260841 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be8c88-8c80-4e9b-97cd-2b84d784ee2c service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.262133 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be8c88-8c80-4e9b-97cd-2b84d784ee2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.314354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc1e668ef6547bd9426446f44e9abdc'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:45.338376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc1e668ef6547bd9426446f44e9abdc'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:45.338979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc1e668ef6547bd9426446f44e9abdc'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:45.362098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc1e668ef6547bd9426446f44e9abdc'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:45.391373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-ae4dcc20-665f-486e-bcf3-edf62c6fc986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc1e668ef6547bd9426446f44e9abdc'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:45.402991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be8c88-8c80-4e9b-97cd-2b84d784ee2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.406110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be8c88-8c80-4e9b-97cd-2b84d784ee2c service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.420695 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 844/1692] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:45.422005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be8c88-8c80-4e9b-97cd-2b84d784ee2c service nova] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.425252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 849/1693] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:50:44 2022] DELETE /identity/v3/users/acc1e668ef6547bd9426446f44e9abdc => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:45.438272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be8c88-8c80-4e9b-97cd-2b84d784ee2c service nova] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:45.483240 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.526473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6213-91c2-41e7-a21f-094298d10625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:45.527618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6213-91c2-41e7-a21f-094298d10625 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.527976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6213-91c2-41e7-a21f-094298d10625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.528329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6213-91c2-41e7-a21f-094298d10625 admin admin] PATH_INFO: `/v3/projects/94499344209443709a01cedaa9ce4a4c/users/764c6fcf66364778a386f33c930dc383/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.560926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6213-91c2-41e7-a21f-094298d10625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94499344209443709a01cedaa9ce4a4c, user_id=764c6fcf66364778a386f33c930dc383, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:45.565697 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6213-91c2-41e7-a21f-094298d10625 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:45.588308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 845/1694] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:45 2022] PUT /identity/v3/projects/94499344209443709a01cedaa9ce4a4c/users/764c6fcf66364778a386f33c930dc383/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:45.599303 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651f09-bf90-42c8-ba79-c17f44308a48 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.599800 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651f09-bf90-42c8-ba79-c17f44308a48 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.599870 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651f09-bf90-42c8-ba79-c17f44308a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.706163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-0e651f09-bf90-42c8-ba79-c17f44308a48 None None] MFA Rules not processed for user `764c6fcf66364778a386f33c930dc383`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:45.709193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-0e651f09-bf90-42c8-ba79-c17f44308a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:45.714991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10ef42-0861-4165-8b2b-bf3f1fed2038 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:45.715494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10ef42-0861-4165-8b2b-bf3f1fed2038 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:45.715942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10ef42-0861-4165-8b2b-bf3f1fed2038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:45.764278 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-ac10ef42-0861-4165-8b2b-bf3f1fed2038 None None] MFA Rules not processed for user `cd2f4a2f2f06432b9c9352ac707a6527`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:45.767009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ac10ef42-0861-4165-8b2b-bf3f1fed2038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:45.867239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:45.917677 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 850/1695] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:45.920714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e651f09-bf90-42c8-ba79-c17f44308a48 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:45.924106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-0e651f09-bf90-42c8-ba79-c17f44308a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:45.938461 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 846/1696] 10.222.0.13 () {58 vars in 1009 bytes} [Wed May 25 13:50:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:46.067245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10ef42-0861-4165-8b2b-bf3f1fed2038 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.069305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-ac10ef42-0861-4165-8b2b-bf3f1fed2038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:46.199177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e651f09-bf90-42c8-ba79-c17f44308a48 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.213852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.217618 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.218646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.219580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.220386 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.228565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.316153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 851/1697] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:45 2022] POST /identity/v3/projects => generated 381 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:46.317233 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.321438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:46.338368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10ef42-0861-4165-8b2b-bf3f1fed2038 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.572515 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.573512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.573857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.581015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] PATH_INFO: `/v3/projects/2c3be95cb6cf43e48d742160f322c42d` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.584618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3be95cb6cf43e48d742160f322c42d)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.587403 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.602212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:46.603061 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3661-204f-4fd5-ab9c-57e5d5fc5da1 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.627493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e19f-7ef6-4225-adb5-a9b91a1b07d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2759d80c45b46bda24dd9509ea089ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.628232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e19f-7ef6-4225-adb5-a9b91a1b07d7 service swift] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.628930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e19f-7ef6-4225-adb5-a9b91a1b07d7 service swift] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.629217 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e19f-7ef6-4225-adb5-a9b91a1b07d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.772424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3be95cb6cf43e48d742160f322c42d', 'request_id': 'req-6c260e17-23c5-438b-a133-e99ab7691222'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:46.789352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3be95cb6cf43e48d742160f322c42d', 'request_id': 'req-6c260e17-23c5-438b-a133-e99ab7691222'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:46.806701 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3be95cb6cf43e48d742160f322c42d', 'request_id': 'req-6c260e17-23c5-438b-a133-e99ab7691222'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:46.830606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] The token cache is being invalidate because project 2c3be95cb6cf43e48d742160f322c42d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:50:46.831181 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:46.832110 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:46.834679 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 847/1698] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:46 2022] DELETE /identity/v3/projects/2c3be95cb6cf43e48d742160f322c42d => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:50:46.840256 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:46.842991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:46.873825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373e19f-7ef6-4225-adb5-a9b91a1b07d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.875490 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373e19f-7ef6-4225-adb5-a9b91a1b07d7 service swift] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:46.904720 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 852/1699] 10.222.0.13 () {60 vars in 1384 bytes} [Wed May 25 13:50:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 13:50:46.907826 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df8b5-64af-4177-a1a7-6ae951d2029c None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.908194 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df8b5-64af-4177-a1a7-6ae951d2029c None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.908470 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df8b5-64af-4177-a1a7-6ae951d2029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.947793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c260e17-23c5-438b-a133-e99ab7691222 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:46.962952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-533df8b5-64af-4177-a1a7-6ae951d2029c None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:46.964339 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-533df8b5-64af-4177-a1a7-6ae951d2029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:46.976566 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840562c-7297-4325-9f97-85fed408db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:46.986429 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 853/1700] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:46.987633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4db2f-1759-47fa-afae-e3bcdf48456a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.987934 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4db2f-1759-47fa-afae-e3bcdf48456a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.988240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4db2f-1759-47fa-afae-e3bcdf48456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.988754 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840562c-7297-4325-9f97-85fed408db4f admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:46.989083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840562c-7297-4325-9f97-85fed408db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:46.989373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840562c-7297-4325-9f97-85fed408db4f admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:46.990163 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840562c-7297-4325-9f97-85fed408db4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:46.992253 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840562c-7297-4325-9f97-85fed408db4f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.059670 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-32f4db2f-1759-47fa-afae-e3bcdf48456a None None] MFA Rules not processed for user `6f66a907c810404aa8e2edfffaffc608`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:47.061091 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-32f4db2f-1759-47fa-afae-e3bcdf48456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:47.066412 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 848/1701] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:46 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:47.067799 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109908-0a5e-4cd7-9e3b-5e489d8b764f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.068103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109908-0a5e-4cd7-9e3b-5e489d8b764f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.068388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109908-0a5e-4cd7-9e3b-5e489d8b764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.086413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:47.138185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-98109908-0a5e-4cd7-9e3b-5e489d8b764f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:47.142072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-98109908-0a5e-4cd7-9e3b-5e489d8b764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:47.172845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 849/1702] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:47.173794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98109908-0a5e-4cd7-9e3b-5e489d8b764f None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.198298 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98109908-0a5e-4cd7-9e3b-5e489d8b764f None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.218216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1326c-04a0-499c-acff-9f0ad492ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.218918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1326c-04a0-499c-acff-9f0ad492ff6e admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.219211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1326c-04a0-499c-acff-9f0ad492ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.219497 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1326c-04a0-499c-acff-9f0ad492ff6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.220245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1326c-04a0-499c-acff-9f0ad492ff6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.223016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1326c-04a0-499c-acff-9f0ad492ff6e admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.246096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 854/1703] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:47.267238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4db2f-1759-47fa-afae-e3bcdf48456a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.267746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 850/1704] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:47.277152 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1326c-04a0-499c-acff-9f0ad492ff6e admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.301218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4db2f-1759-47fa-afae-e3bcdf48456a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.305850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1326c-04a0-499c-acff-9f0ad492ff6e admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.318800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5cb53-ef7b-4f75-8a9e-a9b984c70bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.319767 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cb53-ef7b-4f75-8a9e-a9b984c70bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.320554 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cb53-ef7b-4f75-8a9e-a9b984c70bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.320833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cb53-ef7b-4f75-8a9e-a9b984c70bc6 admin admin] PATH_INFO: `/v3/projects/4645d9d0e16f42369bcec90040433d55/users/ab1f3d2a676948e19f31a5fac4abb2c4/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.322764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.323673 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.324180 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.325075 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.326215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:47.326889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.345007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.359312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5cb53-ef7b-4f75-8a9e-a9b984c70bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4645d9d0e16f42369bcec90040433d55, user_id=ab1f3d2a676948e19f31a5fac4abb2c4, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.366188 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5cb53-ef7b-4f75-8a9e-a9b984c70bc6 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.367025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 855/1705] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:47.372508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.392638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 851/1706] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:47 2022] PUT /identity/v3/projects/4645d9d0e16f42369bcec90040433d55/users/ab1f3d2a676948e19f31a5fac4abb2c4/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:47.397177 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5cb53-ef7b-4f75-8a9e-a9b984c70bc6 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.400958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abea8a-c892-40aa-a505-897c19554113 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.489943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1bf6d-d2f7-41ab-b6ff-5a50abd56d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.492409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1bf6d-d2f7-41ab-b6ff-5a50abd56d94 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.492733 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1bf6d-d2f7-41ab-b6ff-5a50abd56d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.493025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1bf6d-d2f7-41ab-b6ff-5a50abd56d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.493809 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1bf6d-d2f7-41ab-b6ff-5a50abd56d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.496020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1bf6d-d2f7-41ab-b6ff-5a50abd56d94 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.503497 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:47.537373 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5cb53-ef7b-4f75-8a9e-a9b984c70bc6 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.550134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1bcca-821e-48a5-8b6f-cebb10b9e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.554856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1bcca-821e-48a5-8b6f-cebb10b9e147 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.554856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1bcca-821e-48a5-8b6f-cebb10b9e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.554856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1bcca-821e-48a5-8b6f-cebb10b9e147 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.554856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1bcca-821e-48a5-8b6f-cebb10b9e147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.554856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1bcca-821e-48a5-8b6f-cebb10b9e147 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.558326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 856/1707] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:47 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:47.561413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1bf6d-d2f7-41ab-b6ff-5a50abd56d94 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.575208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 852/1708] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:47.591323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1bcca-821e-48a5-8b6f-cebb10b9e147 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.612804 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1bcca-821e-48a5-8b6f-cebb10b9e147 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.665790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1bf6d-d2f7-41ab-b6ff-5a50abd56d94 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.671700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cb5e6-22c5-48b7-853f-34876ba7e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.672602 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb5e6-22c5-48b7-853f-34876ba7e5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.672932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb5e6-22c5-48b7-853f-34876ba7e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.673224 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb5e6-22c5-48b7-853f-34876ba7e5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.674064 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cb5e6-22c5-48b7-853f-34876ba7e5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.676269 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cb5e6-22c5-48b7-853f-34876ba7e5f8 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.705777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 857/1709] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:47 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:47.710181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cb5e6-22c5-48b7-853f-34876ba7e5f8 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.711720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bea39-9c28-4fd2-a8d6-482749d34275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.712712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bea39-9c28-4fd2-a8d6-482749d34275 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.713005 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bea39-9c28-4fd2-a8d6-482749d34275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.713301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bea39-9c28-4fd2-a8d6-482749d34275 admin admin] PATH_INFO: `/v3/projects/4645d9d0e16f42369bcec90040433d55/users/ab1f3d2a676948e19f31a5fac4abb2c4/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.715648 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bea39-9c28-4fd2-a8d6-482749d34275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4645d9d0e16f42369bcec90040433d55, user_id=ab1f3d2a676948e19f31a5fac4abb2c4, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.718996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bea39-9c28-4fd2-a8d6-482749d34275 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.724993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cb5e6-22c5-48b7-853f-34876ba7e5f8 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.733220 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee164271-6aa6-4367-80c4-b669f4bddfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.734231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164271-6aa6-4367-80c4-b669f4bddfcc admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.734695 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164271-6aa6-4367-80c4-b669f4bddfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.735186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164271-6aa6-4367-80c4-b669f4bddfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.736924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee164271-6aa6-4367-80c4-b669f4bddfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.739351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee164271-6aa6-4367-80c4-b669f4bddfcc admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.755735 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 858/1710] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:47.761266 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee164271-6aa6-4367-80c4-b669f4bddfcc admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.785827 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee164271-6aa6-4367-80c4-b669f4bddfcc admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:47.798692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:47.799670 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 853/1711] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:47 2022] PUT /identity/v3/projects/4645d9d0e16f42369bcec90040433d55/users/ab1f3d2a676948e19f31a5fac4abb2c4/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:47.802010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9588bee-1406-40c9-9488-841eda79233a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.802010 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9588bee-1406-40c9-9488-841eda79233a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.802474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9588bee-1406-40c9-9488-841eda79233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.844851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-a9588bee-1406-40c9-9488-841eda79233a None None] MFA Rules not processed for user `ab1f3d2a676948e19f31a5fac4abb2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:47.847275 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a9588bee-1406-40c9-9488-841eda79233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:47.936672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79102c-e9aa-4e81-ac75-ef3c79a54e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:47.937495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79102c-e9aa-4e81-ac75-ef3c79a54e51 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:47.937891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79102c-e9aa-4e81-ac75-ef3c79a54e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:47.938254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79102c-e9aa-4e81-ac75-ef3c79a54e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:47.940544 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79102c-e9aa-4e81-ac75-ef3c79a54e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:47.942772 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79102c-e9aa-4e81-ac75-ef3c79a54e51 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:47.965594 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 859/1712] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:47.967094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 854/1713] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:47.970696 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79102c-e9aa-4e81-ac75-ef3c79a54e51 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.988628 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9588bee-1406-40c9-9488-841eda79233a None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:47.993541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a9588bee-1406-40c9-9488-841eda79233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:48.024584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79102c-e9aa-4e81-ac75-ef3c79a54e51 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:48.050218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ceac5-6225-42c1-9319-e83d3fb87ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:48.051153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ceac5-6225-42c1-9319-e83d3fb87ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.051445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ceac5-6225-42c1-9319-e83d3fb87ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.051729 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ceac5-6225-42c1-9319-e83d3fb87ad1 admin admin] PATH_INFO: `/v3/projects/ececadefae0a4f6f97ed5a62bda91c9b/users/a92bb3dd8c2f42c7b490c53a82d75ad6/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.115160 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ceac5-6225-42c1-9319-e83d3fb87ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ececadefae0a4f6f97ed5a62bda91c9b, user_id=a92bb3dd8c2f42c7b490c53a82d75ad6, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:48.121977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ceac5-6225-42c1-9319-e83d3fb87ad1 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:48.149206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 860/1714] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:47 2022] PUT /identity/v3/projects/ececadefae0a4f6f97ed5a62bda91c9b/users/a92bb3dd8c2f42c7b490c53a82d75ad6/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:48.163602 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa88c2-686d-4aa7-beb6-675fcdff7c7f None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.164119 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa88c2-686d-4aa7-beb6-675fcdff7c7f None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.164545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa88c2-686d-4aa7-beb6-675fcdff7c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.215238 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9588bee-1406-40c9-9488-841eda79233a None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:48.218126 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-44fa88c2-686d-4aa7-beb6-675fcdff7c7f None None] MFA Rules not processed for user `a92bb3dd8c2f42c7b490c53a82d75ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:48.219650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-44fa88c2-686d-4aa7-beb6-675fcdff7c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:48.234225 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:48.320283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a59d3-4899-4e73-ae8b-84fd5216acdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:48.322140 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a59d3-4899-4e73-ae8b-84fd5216acdf service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.322596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a59d3-4899-4e73-ae8b-84fd5216acdf service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.323140 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a59d3-4899-4e73-ae8b-84fd5216acdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.394307 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 861/1715] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:48.396695 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa88c2-686d-4aa7-beb6-675fcdff7c7f None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:48.546158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a59d3-4899-4e73-ae8b-84fd5216acdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:48.549902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a59d3-4899-4e73-ae8b-84fd5216acdf service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:48.569007 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa88c2-686d-4aa7-beb6-675fcdff7c7f None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:48.580364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6509e4d-cdb4-45c2-ba8f-f8e878cb8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:48.581468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509e4d-cdb4-45c2-ba8f-f8e878cb8f2e admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.581955 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509e4d-cdb4-45c2-ba8f-f8e878cb8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.582416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509e4d-cdb4-45c2-ba8f-f8e878cb8f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.584580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6509e4d-cdb4-45c2-ba8f-f8e878cb8f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:48.585266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 855/1716] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:48.591483 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6509e4d-cdb4-45c2-ba8f-f8e878cb8f2e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:48.636924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:48.681627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 862/1717] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:48 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:48.684145 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a59d3-4899-4e73-ae8b-84fd5216acdf service cinder] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:48.700937 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a59d3-4899-4e73-ae8b-84fd5216acdf service cinder] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:48.876121 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dcdee-775c-41dd-acc2-e9301097b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:48.878109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dcdee-775c-41dd-acc2-e9301097b6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.878613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dcdee-775c-41dd-acc2-e9301097b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.879178 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dcdee-775c-41dd-acc2-e9301097b6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.880131 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391dcdee-775c-41dd-acc2-e9301097b6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:48.882576 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391dcdee-775c-41dd-acc2-e9301097b6b6 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:48.928759 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6509e4d-cdb4-45c2-ba8f-f8e878cb8f2e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:48.938815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 856/1718] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:48 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:48.948111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6509e4d-cdb4-45c2-ba8f-f8e878cb8f2e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:48.962768 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c3c5-9034-4492-a07d-d6bf5eb7ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:48.964333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c3c5-9034-4492-a07d-d6bf5eb7ef7b admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:48.966944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c3c5-9034-4492-a07d-d6bf5eb7ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:48.968485 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c3c5-9034-4492-a07d-d6bf5eb7ef7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:48.971396 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319c3c5-9034-4492-a07d-d6bf5eb7ef7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:48.979359 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319c3c5-9034-4492-a07d-d6bf5eb7ef7b admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.015237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dcdee-775c-41dd-acc2-e9301097b6b6 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.027712 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 863/1719] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:49.034650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dcdee-775c-41dd-acc2-e9301097b6b6 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.050838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb728a9-2490-4a9f-9c70-255fb0dda587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.053581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb728a9-2490-4a9f-9c70-255fb0dda587 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.056431 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb728a9-2490-4a9f-9c70-255fb0dda587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.058111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb728a9-2490-4a9f-9c70-255fb0dda587 admin admin] PATH_INFO: `/v3/projects/4ff7794afeff4a489e019c068ac131ea/users/997c17a07a404887a7f4121622a8b95b/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.115879 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb728a9-2490-4a9f-9c70-255fb0dda587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff7794afeff4a489e019c068ac131ea, user_id=997c17a07a404887a7f4121622a8b95b, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.124374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb728a9-2490-4a9f-9c70-255fb0dda587 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.171765 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c3c5-9034-4492-a07d-d6bf5eb7ef7b admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.172474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 857/1720] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:49 2022] PUT /identity/v3/projects/4ff7794afeff4a489e019c068ac131ea/users/997c17a07a404887a7f4121622a8b95b/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:49.188392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c3c5-9034-4492-a07d-d6bf5eb7ef7b admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.353164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152c01-52a5-4a9b-89b0-8354e8a1c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.353998 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152c01-52a5-4a9b-89b0-8354e8a1c0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.354282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152c01-52a5-4a9b-89b0-8354e8a1c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.354568 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152c01-52a5-4a9b-89b0-8354e8a1c0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.355321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152c01-52a5-4a9b-89b0-8354e8a1c0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.356962 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152c01-52a5-4a9b-89b0-8354e8a1c0d1 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.385726 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 864/1721] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:49.389995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb728a9-2490-4a9f-9c70-255fb0dda587 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.406281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152c01-52a5-4a9b-89b0-8354e8a1c0d1 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.408148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb728a9-2490-4a9f-9c70-255fb0dda587 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.416302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efd913-70c2-4cff-995c-f3218176d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.417810 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd913-70c2-4cff-995c-f3218176d945 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.418324 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd913-70c2-4cff-995c-f3218176d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.418862 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd913-70c2-4cff-995c-f3218176d945 admin admin] PATH_INFO: `/v3/projects/4ff7794afeff4a489e019c068ac131ea/users/997c17a07a404887a7f4121622a8b95b/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.422330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efd913-70c2-4cff-995c-f3218176d945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff7794afeff4a489e019c068ac131ea, user_id=997c17a07a404887a7f4121622a8b95b, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.438597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efd913-70c2-4cff-995c-f3218176d945 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.485501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 858/1722] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:49 2022] PUT /identity/v3/projects/4ff7794afeff4a489e019c068ac131ea/users/997c17a07a404887a7f4121622a8b95b/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:49.487173 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080aebe-dcc7-44e5-9514-c21f621f88bb None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.487513 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080aebe-dcc7-44e5-9514-c21f621f88bb None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.487809 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080aebe-dcc7-44e5-9514-c21f621f88bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.547898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:49.552253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152c01-52a5-4a9b-89b0-8354e8a1c0d1 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.557278 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-7080aebe-dcc7-44e5-9514-c21f621f88bb None None] MFA Rules not processed for user `997c17a07a404887a7f4121622a8b95b`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:49.560886 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-7080aebe-dcc7-44e5-9514-c21f621f88bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:49.669567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1f3d2a676948e19f31a5fac4abb2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4645d9d0e16f42369bcec90040433d55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.670833 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.671277 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.671714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.673025 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:49.673806 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.693239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.732351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 865/1723] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:49.737062 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.766906 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 859/1724] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:49.772432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d4a52-362a-46c6-98ae-1c2e6b0ecef1 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.777333 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080aebe-dcc7-44e5-9514-c21f621f88bb None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.783918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-7080aebe-dcc7-44e5-9514-c21f621f88bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:49.799945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475a3ff-0f5d-4297-bb64-ccb5265b6a23 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1f3d2a676948e19f31a5fac4abb2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4645d9d0e16f42369bcec90040433d55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.800640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475a3ff-0f5d-4297-bb64-ccb5265b6a23 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.800938 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475a3ff-0f5d-4297-bb64-ccb5265b6a23 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.801227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475a3ff-0f5d-4297-bb64-ccb5265b6a23 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:49.801995 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475a3ff-0f5d-4297-bb64-ccb5265b6a23 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:49.805511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475a3ff-0f5d-4297-bb64-ccb5265b6a23 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:49.850741 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:49.864214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 866/1725] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:49 2022] POST /identity/v3/projects => generated 354 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:49.869336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475a3ff-0f5d-4297-bb64-ccb5265b6a23 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:49.900537 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080aebe-dcc7-44e5-9514-c21f621f88bb None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:49.979235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348427-36a5-480c-bbdd-95459f9eb8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:49.979918 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348427-36a5-480c-bbdd-95459f9eb8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:49.980196 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348427-36a5-480c-bbdd-95459f9eb8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:49.980481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348427-36a5-480c-bbdd-95459f9eb8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.047689 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475a3ff-0f5d-4297-bb64-ccb5265b6a23 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.070855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4802f-3baf-4a92-abb2-c650e64b4e7c tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1f3d2a676948e19f31a5fac4abb2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4645d9d0e16f42369bcec90040433d55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.071847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4802f-3baf-4a92-abb2-c650e64b4e7c tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.073191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4802f-3baf-4a92-abb2-c650e64b4e7c tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.073592 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4802f-3baf-4a92-abb2-c650e64b4e7c tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.081041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4802f-3baf-4a92-abb2-c650e64b4e7c tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:50.081645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4802f-3baf-4a92-abb2-c650e64b4e7c tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.083587 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4802f-3baf-4a92-abb2-c650e64b4e7c tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.108374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 867/1726] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:50.110763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575153-b32b-4177-b063-62f8cb49a8b0 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.110763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575153-b32b-4177-b063-62f8cb49a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.111152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575153-b32b-4177-b063-62f8cb49a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.131375 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2348427-36a5-480c-bbdd-95459f9eb8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.133707 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2348427-36a5-480c-bbdd-95459f9eb8d5 service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.148071 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-a4575153-b32b-4177-b063-62f8cb49a8b0 None None] MFA Rules not processed for user `04e1c5462d614e1cb1153fa28c901a04`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:50.151185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-a4575153-b32b-4177-b063-62f8cb49a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:50.152071 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 860/1727] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:50:50.283037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 868/1728] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:50.301252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348427-36a5-480c-bbdd-95459f9eb8d5 service cinder] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:50.325517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348427-36a5-480c-bbdd-95459f9eb8d5 service cinder] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:50.366981 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1f3d2a676948e19f31a5fac4abb2c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4645d9d0e16f42369bcec90040433d55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:50.367898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.368194 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.374491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] PATH_INFO: `/v3/projects/1e2be384256047049b3f21c978a5848b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.385211 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e2be384256047049b3f21c978a5848b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:50.387649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:50.419161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:50.600009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2be384256047049b3f21c978a5848b', 'request_id': 'req-575ce4d4-e57c-4693-a64b-1eff8c24a965'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:50.615075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2be384256047049b3f21c978a5848b', 'request_id': 'req-575ce4d4-e57c-4693-a64b-1eff8c24a965'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:50.624509 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2be384256047049b3f21c978a5848b', 'request_id': 'req-575ce4d4-e57c-4693-a64b-1eff8c24a965'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:50.686611 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] The token cache is being invalidate because project 1e2be384256047049b3f21c978a5848b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:50:50.688787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:50.699190 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445870-41c8-422d-8ab9-81ea5be2ce10 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:50.700350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445870-41c8-422d-8ab9-81ea5be2ce10 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:50.700850 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445870-41c8-422d-8ab9-81ea5be2ce10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:50.705374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:50.708653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 861/1729] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:50 2022] DELETE /identity/v3/projects/1e2be384256047049b3f21c978a5848b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:50.779704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-1a445870-41c8-422d-8ab9-81ea5be2ce10 None None] MFA Rules not processed for user `5d7bc855c20b431b9aabaee20101b79c`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:50.781000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-1a445870-41c8-422d-8ab9-81ea5be2ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:51.024468 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 869/1730] 10.222.0.44 () {58 vars in 1015 bytes} [Wed May 25 13:50:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:51.054901 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:51.057148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:51.078566 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce4d4-e57c-4693-a64b-1eff8c24a965 tempest-VolumeQuotaClassesTest-1108005687 tempest-VolumeQuotaClassesTest-1108005687-project-admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:51.097692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9deda82-4a7f-4b54-aa92-ccf0d0a31851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:51.101174 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deda82-4a7f-4b54-aa92-ccf0d0a31851 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.101614 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deda82-4a7f-4b54-aa92-ccf0d0a31851 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.102501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deda82-4a7f-4b54-aa92-ccf0d0a31851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.136104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9deda82-4a7f-4b54-aa92-ccf0d0a31851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:51.137600 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9deda82-4a7f-4b54-aa92-ccf0d0a31851 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:51.155534 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 862/1731] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:51.224243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445870-41c8-422d-8ab9-81ea5be2ce10 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:51.227062 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-1a445870-41c8-422d-8ab9-81ea5be2ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:51.277343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae89b9-ce5d-4cb2-8aac-699f8343f6a1 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.278190 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae89b9-ce5d-4cb2-8aac-699f8343f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.281452 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae89b9-ce5d-4cb2-8aac-699f8343f6a1 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.289515 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 863/1732] 10.222.0.13 () {54 vars in 912 bytes} [Wed May 25 13:50:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:51.295860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54f43-15ba-4298-9acd-31e864279256 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.296601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54f43-15ba-4298-9acd-31e864279256 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.297035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54f43-15ba-4298-9acd-31e864279256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.374487 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-f3b54f43-15ba-4298-9acd-31e864279256 None None] MFA Rules not processed for user `5d7bc855c20b431b9aabaee20101b79c`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:51.376565 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-f3b54f43-15ba-4298-9acd-31e864279256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:51.392271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 864/1733] 10.222.0.13 () {58 vars in 1009 bytes} [Wed May 25 13:50:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:51.412304 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b54f43-15ba-4298-9acd-31e864279256 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:51.426746 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:51.428334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b54f43-15ba-4298-9acd-31e864279256 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:51.440418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95256fac-3dbf-474b-b6ec-2e762f1cae88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:51.441251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95256fac-3dbf-474b-b6ec-2e762f1cae88 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.441653 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95256fac-3dbf-474b-b6ec-2e762f1cae88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.441845 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95256fac-3dbf-474b-b6ec-2e762f1cae88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.453606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95256fac-3dbf-474b-b6ec-2e762f1cae88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:51.456864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95256fac-3dbf-474b-b6ec-2e762f1cae88 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:51.466113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445870-41c8-422d-8ab9-81ea5be2ce10 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:51.468618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 865/1734] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:50:51.476550 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:51.477520 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.477763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.486418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] PATH_INFO: `/v3/users/764c6fcf66364778a386f33c930dc383` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.487788 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764c6fcf66364778a386f33c930dc383)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:51.491633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:51.572125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764c6fcf66364778a386f33c930dc383'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:51.582447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764c6fcf66364778a386f33c930dc383'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:51.583398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764c6fcf66364778a386f33c930dc383'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:51.595047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764c6fcf66364778a386f33c930dc383'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:51.620368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764c6fcf66364778a386f33c930dc383'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:51.630572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 870/1735] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:50:51 2022] DELETE /identity/v3/users/764c6fcf66364778a386f33c930dc383 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:51.636488 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20b8f-bd70-4fba-ba10-ef028053d3ce None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.637020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20b8f-bd70-4fba-ba10-ef028053d3ce None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.637020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20b8f-bd70-4fba-ba10-ef028053d3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.661062 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-47a20b8f-bd70-4fba-ba10-ef028053d3ce None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:51.662757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-47a20b8f-bd70-4fba-ba10-ef028053d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:51.758922 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 866/1736] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:51.769615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:51.773150 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:51.881459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90bb31-d84d-4dbe-a635-c34d91711f24 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:51.887820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957a9d5-fd27-48ac-a3d5-05bfe6f8dbeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:51.888644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957a9d5-fd27-48ac-a3d5-05bfe6f8dbeb service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:51.889002 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957a9d5-fd27-48ac-a3d5-05bfe6f8dbeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:51.889359 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957a9d5-fd27-48ac-a3d5-05bfe6f8dbeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:51.901234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957a9d5-fd27-48ac-a3d5-05bfe6f8dbeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:51.903429 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957a9d5-fd27-48ac-a3d5-05bfe6f8dbeb service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:51.913876 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 871/1737] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:52.375459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a20b8f-bd70-4fba-ba10-ef028053d3ce None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:52.377247 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-47a20b8f-bd70-4fba-ba10-ef028053d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:52.395268 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a20b8f-bd70-4fba-ba10-ef028053d3ce None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:52.400479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:52.401371 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.401664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.402006 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] PATH_INFO: `/v3/projects/94499344209443709a01cedaa9ce4a4c` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.404436 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] RBAC: Authorizing `identity:delete_project(project_id=94499344209443709a01cedaa9ce4a4c)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:52.406673 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:52.568589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94499344209443709a01cedaa9ce4a4c', 'request_id': 'req-3a801b13-13d7-497c-88c2-61c254dbbdae'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:52.596437 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94499344209443709a01cedaa9ce4a4c', 'request_id': 'req-3a801b13-13d7-497c-88c2-61c254dbbdae'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:52.602321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:52.610249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94499344209443709a01cedaa9ce4a4c', 'request_id': 'req-3a801b13-13d7-497c-88c2-61c254dbbdae'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:52.634168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] The token cache is being invalidate because project 94499344209443709a01cedaa9ce4a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:50:52.635311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:52.636205 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3a801b13-13d7-497c-88c2-61c254dbbdae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:52.638041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 867/1738] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:52 2022] DELETE /identity/v3/projects/94499344209443709a01cedaa9ce4a4c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:52.642321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957a9d5-fd27-48ac-a3d5-05bfe6f8dbeb service neutron] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:52.659140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957a9d5-fd27-48ac-a3d5-05bfe6f8dbeb service neutron] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:52.874406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:52.881171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:52.881915 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:52.883038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] PATH_INFO: `/v3/users/ab1f3d2a676948e19f31a5fac4abb2c4` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:52.885279 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1f3d2a676948e19f31a5fac4abb2c4)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:52.890416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:52.929891 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:52.999662 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1f3d2a676948e19f31a5fac4abb2c4'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.041612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1f3d2a676948e19f31a5fac4abb2c4'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.042443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1f3d2a676948e19f31a5fac4abb2c4'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.062478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1f3d2a676948e19f31a5fac4abb2c4'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.083337 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f4e21624-61b9-4864-9b74-ec626132eb5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1f3d2a676948e19f31a5fac4abb2c4'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.093626 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 872/1739] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:50:52 2022] DELETE /identity/v3/users/ab1f3d2a676948e19f31a5fac4abb2c4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:53.138134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962b03e-3960-4e48-a2bc-a1462212dd44 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.138811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962b03e-3960-4e48-a2bc-a1462212dd44 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.139647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962b03e-3960-4e48-a2bc-a1462212dd44 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.141368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 868/1740] 10.222.0.13 () {54 vars in 921 bytes} [Wed May 25 13:50:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:50:53.154064 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af4e84-ec3f-4432-a805-93a654117607 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.154366 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af4e84-ec3f-4432-a805-93a654117607 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.154651 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af4e84-ec3f-4432-a805-93a654117607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.188253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-10af4e84-ec3f-4432-a805-93a654117607 None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:53.200383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-10af4e84-ec3f-4432-a805-93a654117607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:53.331455 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 873/1741] 10.222.0.13 () {58 vars in 1018 bytes} [Wed May 25 13:50:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:53.385188 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962b03e-3960-4e48-a2bc-a1462212dd44 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.388209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-d962b03e-3960-4e48-a2bc-a1462212dd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:53.409329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962b03e-3960-4e48-a2bc-a1462212dd44 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.415588 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627d6be-5fb9-47a1-9a86-54078cd1c3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.416254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d6be-5fb9-47a1-9a86-54078cd1c3cc service nova] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.416541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d6be-5fb9-47a1-9a86-54078cd1c3cc service nova] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.416823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d6be-5fb9-47a1-9a86-54078cd1c3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.426559 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627d6be-5fb9-47a1-9a86-54078cd1c3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.428168 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627d6be-5fb9-47a1-9a86-54078cd1c3cc service nova] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.443013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 869/1742] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:53.444786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af4e84-ec3f-4432-a805-93a654117607 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.446285 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-10af4e84-ec3f-4432-a805-93a654117607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:53.516343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af4e84-ec3f-4432-a805-93a654117607 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.521957 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.523350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.523639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.523920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] PATH_INFO: `/v3/projects/4645d9d0e16f42369bcec90040433d55` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.525128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4645d9d0e16f42369bcec90040433d55)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.526335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: WARNING py.warnings [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 13:50:53.526335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: warnings.warn(msg) May 25 13:50:53.526335 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: May 25 13:50:53.527518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.554558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:53.591898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4645d9d0e16f42369bcec90040433d55', 'request_id': 'req-8b48cf43-7f3a-46aa-95f1-b6a822368a89'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.605656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4645d9d0e16f42369bcec90040433d55', 'request_id': 'req-8b48cf43-7f3a-46aa-95f1-b6a822368a89'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.612609 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4645d9d0e16f42369bcec90040433d55', 'request_id': 'req-8b48cf43-7f3a-46aa-95f1-b6a822368a89'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.624985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] The token cache is being invalidate because project 4645d9d0e16f42369bcec90040433d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:50:53.625287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.626028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-8b48cf43-7f3a-46aa-95f1-b6a822368a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:53.627701 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 874/1743] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:53 2022] DELETE /identity/v3/projects/4645d9d0e16f42369bcec90040433d55 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:53.633058 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82e09c-2182-4f2f-b292-88c69b168f13 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.633356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82e09c-2182-4f2f-b292-88c69b168f13 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.633637 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82e09c-2182-4f2f-b292-88c69b168f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.652456 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-cd82e09c-2182-4f2f-b292-88c69b168f13 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:53.653782 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-cd82e09c-2182-4f2f-b292-88c69b168f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:53.713098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 870/1744] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:53.721301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb396e05-f014-49fd-8495-35ec42495aad None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.721713 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb396e05-f014-49fd-8495-35ec42495aad None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.722033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb396e05-f014-49fd-8495-35ec42495aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.742367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-fb396e05-f014-49fd-8495-35ec42495aad None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:53.743580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-fb396e05-f014-49fd-8495-35ec42495aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:53.751497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 875/1745] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:53.755775 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82e09c-2182-4f2f-b292-88c69b168f13 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.770296 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82e09c-2182-4f2f-b292-88c69b168f13 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.775545 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.776213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.776497 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.776800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.777523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:53.777869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.779484 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.797291 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 871/1746] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:53.801697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb396e05-f014-49fd-8495-35ec42495aad None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.810887 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb396e05-f014-49fd-8495-35ec42495aad None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.815696 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faeb20-39b1-4a53-a75c-229c31a7ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.816351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faeb20-39b1-4a53-a75c-229c31a7ffc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.816634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faeb20-39b1-4a53-a75c-229c31a7ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.816906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faeb20-39b1-4a53-a75c-229c31a7ffc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.817604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faeb20-39b1-4a53-a75c-229c31a7ffc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.820096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faeb20-39b1-4a53-a75c-229c31a7ffc1 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.846199 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 876/1747] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:53 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:53.850394 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.860293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1966482-4b4d-464b-9748-cb9972103a33 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.915627 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b42211-066a-4809-a547-47313038154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.916318 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b42211-066a-4809-a547-47313038154c admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.916601 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b42211-066a-4809-a547-47313038154c admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.916969 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b42211-066a-4809-a547-47313038154c admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.917544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b42211-066a-4809-a547-47313038154c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.919539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b42211-066a-4809-a547-47313038154c admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.938927 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 872/1748] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:53 2022] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:53.943068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faeb20-39b1-4a53-a75c-229c31a7ffc1 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.954129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faeb20-39b1-4a53-a75c-229c31a7ffc1 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.958929 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32abf65-634e-4eb4-ac52-2dcbb368c811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.959596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32abf65-634e-4eb4-ac52-2dcbb368c811 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.959884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32abf65-634e-4eb4-ac52-2dcbb368c811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.960823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32abf65-634e-4eb4-ac52-2dcbb368c811 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.961563 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32abf65-634e-4eb4-ac52-2dcbb368c811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.963229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32abf65-634e-4eb4-ac52-2dcbb368c811 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:53.973846 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 877/1749] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:53.977860 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b42211-066a-4809-a547-47313038154c admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:53.987912 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b42211-066a-4809-a547-47313038154c admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:53.993075 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43825ca7-5a19-4b00-afb8-cd1d55b977f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:53.993726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825ca7-5a19-4b00-afb8-cd1d55b977f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:53.994041 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825ca7-5a19-4b00-afb8-cd1d55b977f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:53.994323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825ca7-5a19-4b00-afb8-cd1d55b977f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:53.995056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43825ca7-5a19-4b00-afb8-cd1d55b977f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:53.996675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43825ca7-5a19-4b00-afb8-cd1d55b977f2 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.006976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 873/1750] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:54.011849 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32abf65-634e-4eb4-ac52-2dcbb368c811 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.022240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32abf65-634e-4eb4-ac52-2dcbb368c811 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.027360 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6387c-56d2-4639-b7d5-d13ff38791ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.028266 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6387c-56d2-4639-b7d5-d13ff38791ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.028552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6387c-56d2-4639-b7d5-d13ff38791ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.028832 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6387c-56d2-4639-b7d5-d13ff38791ab admin admin] PATH_INFO: `/v3/projects/ecb1f2e091134255937cc5ccce94af74/users/516bcb4d2c84486fa462519abe62f283/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.047156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6387c-56d2-4639-b7d5-d13ff38791ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb1f2e091134255937cc5ccce94af74, user_id=516bcb4d2c84486fa462519abe62f283, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.049978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6387c-56d2-4639-b7d5-d13ff38791ab admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.064502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 878/1751] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:54 2022] PUT /identity/v3/projects/ecb1f2e091134255937cc5ccce94af74/users/516bcb4d2c84486fa462519abe62f283/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:54.075536 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d593b-48e1-4854-a00c-c4d1706b4c24 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.075938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d593b-48e1-4854-a00c-c4d1706b4c24 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.076289 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d593b-48e1-4854-a00c-c4d1706b4c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.108189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-d22d593b-48e1-4854-a00c-c4d1706b4c24 None None] MFA Rules not processed for user `516bcb4d2c84486fa462519abe62f283`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:54.109433 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-d22d593b-48e1-4854-a00c-c4d1706b4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:54.133858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:54.175137 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 874/1752] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:54.180193 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6387c-56d2-4639-b7d5-d13ff38791ab admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.250385 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6387c-56d2-4639-b7d5-d13ff38791ab admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.255215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30645174-ece5-44eb-ba69-15d599e59fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.255882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30645174-ece5-44eb-ba69-15d599e59fbf admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.256175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30645174-ece5-44eb-ba69-15d599e59fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.256457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30645174-ece5-44eb-ba69-15d599e59fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.257877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30645174-ece5-44eb-ba69-15d599e59fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.259825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30645174-ece5-44eb-ba69-15d599e59fbf admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.285785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 879/1753] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:54 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:54.288766 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d593b-48e1-4854-a00c-c4d1706b4c24 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.300135 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d593b-48e1-4854-a00c-c4d1706b4c24 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.357071 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f40bf-cf05-45d3-a947-cd033835a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.357778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f40bf-cf05-45d3-a947-cd033835a422 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.358072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f40bf-cf05-45d3-a947-cd033835a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.358354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f40bf-cf05-45d3-a947-cd033835a422 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.359054 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f40bf-cf05-45d3-a947-cd033835a422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.360999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f40bf-cf05-45d3-a947-cd033835a422 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.380891 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 875/1754] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:54 2022] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:54.384934 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30645174-ece5-44eb-ba69-15d599e59fbf admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.395401 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30645174-ece5-44eb-ba69-15d599e59fbf admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.400210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404c8d-404c-481e-96fe-9b0d94eb4d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.400880 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404c8d-404c-481e-96fe-9b0d94eb4d32 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.401166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404c8d-404c-481e-96fe-9b0d94eb4d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.401447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404c8d-404c-481e-96fe-9b0d94eb4d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.402213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96404c8d-404c-481e-96fe-9b0d94eb4d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.403817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96404c8d-404c-481e-96fe-9b0d94eb4d32 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.417659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 880/1755] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:54.421888 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f40bf-cf05-45d3-a947-cd033835a422 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.433146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f40bf-cf05-45d3-a947-cd033835a422 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.437960 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59521b1-b606-41c2-9ee8-07b147d5994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.438934 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59521b1-b606-41c2-9ee8-07b147d5994b admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.439293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59521b1-b606-41c2-9ee8-07b147d5994b admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.439644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59521b1-b606-41c2-9ee8-07b147d5994b admin admin] PATH_INFO: `/v3/projects/a1dd64ac10fb4cd2af445698d88cdb51/users/cd42c63e58dd44df8bde90b90458f66f/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.462688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59521b1-b606-41c2-9ee8-07b147d5994b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dd64ac10fb4cd2af445698d88cdb51, user_id=cd42c63e58dd44df8bde90b90458f66f, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.465640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59521b1-b606-41c2-9ee8-07b147d5994b admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.482526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 876/1756] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:54 2022] PUT /identity/v3/projects/a1dd64ac10fb4cd2af445698d88cdb51/users/cd42c63e58dd44df8bde90b90458f66f/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:50:54.486450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404c8d-404c-481e-96fe-9b0d94eb4d32 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.498653 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404c8d-404c-481e-96fe-9b0d94eb4d32 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.516284 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:54.560055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1047-c0c7-4bf8-a9f3-f63a2337660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.560642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1047-c0c7-4bf8-a9f3-f63a2337660b admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.560928 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1047-c0c7-4bf8-a9f3-f63a2337660b admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.561208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1047-c0c7-4bf8-a9f3-f63a2337660b admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.561975 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1047-c0c7-4bf8-a9f3-f63a2337660b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.563574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1047-c0c7-4bf8-a9f3-f63a2337660b admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.577120 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 881/1757] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:50:54.578343 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59521b1-b606-41c2-9ee8-07b147d5994b admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.592567 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59521b1-b606-41c2-9ee8-07b147d5994b admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.598097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.599065 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.599348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.599650 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] PATH_INFO: `/v3/projects/a1dd64ac10fb4cd2af445698d88cdb51/users/cd42c63e58dd44df8bde90b90458f66f/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.602210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dd64ac10fb4cd2af445698d88cdb51, user_id=cd42c63e58dd44df8bde90b90458f66f, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.605104 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.624556 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 877/1758] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:54 2022] PUT /identity/v3/projects/a1dd64ac10fb4cd2af445698d88cdb51/users/cd42c63e58dd44df8bde90b90458f66f/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:54.635822 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3419-18ff-4eab-a9ca-dd66555f3f37 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.636128 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3419-18ff-4eab-a9ca-dd66555f3f37 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.636414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3419-18ff-4eab-a9ca-dd66555f3f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.669565 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-4afd3419-18ff-4eab-a9ca-dd66555f3f37 None None] MFA Rules not processed for user `cd42c63e58dd44df8bde90b90458f66f`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:54.670820 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-4afd3419-18ff-4eab-a9ca-dd66555f3f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:54.737803 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 882/1759] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:54.748464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.750308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:54.806759 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cb0f-61f8-4e0f-b43f-54eac58fd47c admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.810664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.811261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.811578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.811861 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.820943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.822430 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.831863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 878/1760] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:54.915227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd3419-18ff-4eab-a9ca-dd66555f3f37 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:54.925229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd3419-18ff-4eab-a9ca-dd66555f3f37 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:54.929122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03d14f-f6a6-4d87-a053-fc916bab62fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:54.929800 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03d14f-f6a6-4d87-a053-fc916bab62fd service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:54.930088 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03d14f-f6a6-4d87-a053-fc916bab62fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:54.930367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03d14f-f6a6-4d87-a053-fc916bab62fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:54.987884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03d14f-f6a6-4d87-a053-fc916bab62fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:54.989819 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03d14f-f6a6-4d87-a053-fc916bab62fd service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:54.999000 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 883/1761] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:56.897252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:56.899176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:56.924411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:56.983339 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe720-8069-440e-b59b-dc9f468cab98 service cinder] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:56.988574 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:56.989467 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:56.989865 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:56.990049 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] PATH_INFO: `/v3/users/d515f8ff5700462aa78ee3b9187c0f2e` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:56.991900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d515f8ff5700462aa78ee3b9187c0f2e)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:56.993884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:57.096015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd515f8ff5700462aa78ee3b9187c0f2e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:57.104684 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd515f8ff5700462aa78ee3b9187c0f2e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:57.140768 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd515f8ff5700462aa78ee3b9187c0f2e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:57.141833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd515f8ff5700462aa78ee3b9187c0f2e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:57.173963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd515f8ff5700462aa78ee3b9187c0f2e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:57.196272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 879/1762] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:50:56 2022] DELETE /identity/v3/users/d515f8ff5700462aa78ee3b9187c0f2e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:57.200707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950be8a-6821-4e4f-8db0-2f31efd71e37 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.201666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950be8a-6821-4e4f-8db0-2f31efd71e37 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.202140 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950be8a-6821-4e4f-8db0-2f31efd71e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.222778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-7950be8a-6821-4e4f-8db0-2f31efd71e37 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:57.224319 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-7950be8a-6821-4e4f-8db0-2f31efd71e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:57.269845 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:57.311293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 884/1763] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:57.322314 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:57.324405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:57.439244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e095e3c-8454-4e87-811d-6bdbf733f0c4 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:57.457671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8d0ec-22ff-42f8-8439-aa94a6ee4e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:57.458387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8d0ec-22ff-42f8-8439-aa94a6ee4e66 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:57.458768 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8d0ec-22ff-42f8-8439-aa94a6ee4e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:57.458979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8d0ec-22ff-42f8-8439-aa94a6ee4e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:57.481597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8d0ec-22ff-42f8-8439-aa94a6ee4e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:57.484274 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8d0ec-22ff-42f8-8439-aa94a6ee4e66 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:57.497769 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 880/1764] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:58.161708 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950be8a-6821-4e4f-8db0-2f31efd71e37 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.163263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-7950be8a-6821-4e4f-8db0-2f31efd71e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:58.178654 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950be8a-6821-4e4f-8db0-2f31efd71e37 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.186033 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.186923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.187215 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.187606 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] PATH_INFO: `/v3/projects/b0ed6349e1e543a58f66517ac387c762` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.188752 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ed6349e1e543a58f66517ac387c762)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.208437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.311288 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ed6349e1e543a58f66517ac387c762', 'request_id': 'req-411bc2a5-df18-4a22-891d-30cd9c5504ec'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:58.318647 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ed6349e1e543a58f66517ac387c762', 'request_id': 'req-411bc2a5-df18-4a22-891d-30cd9c5504ec'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:58.326367 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ed6349e1e543a58f66517ac387c762', 'request_id': 'req-411bc2a5-df18-4a22-891d-30cd9c5504ec'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:58.344331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] The token cache is being invalidate because project b0ed6349e1e543a58f66517ac387c762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:50:58.344728 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:58.345256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-411bc2a5-df18-4a22-891d-30cd9c5504ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:58.346852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 885/1765] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:58 2022] DELETE /identity/v3/projects/b0ed6349e1e543a58f66517ac387c762 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:58.351873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd3640-5e32-4904-93d9-76ec9402f7ee None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.352391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd3640-5e32-4904-93d9-76ec9402f7ee None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.352473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd3640-5e32-4904-93d9-76ec9402f7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.370987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-eedd3640-5e32-4904-93d9-76ec9402f7ee None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:58.372206 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-eedd3640-5e32-4904-93d9-76ec9402f7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:58.417558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:58.440840 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 881/1766] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:58.450360 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fca6-cb50-460d-ad32-4bb629046545 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.450690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fca6-cb50-460d-ad32-4bb629046545 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.450958 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fca6-cb50-460d-ad32-4bb629046545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.471564 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-d109fca6-cb50-460d-ad32-4bb629046545 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:58.472933 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-d109fca6-cb50-460d-ad32-4bb629046545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:58.481271 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 886/1767] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:50:58.485494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd3640-5e32-4904-93d9-76ec9402f7ee None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.495798 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd3640-5e32-4904-93d9-76ec9402f7ee None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.500525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.501640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.501964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.502243 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.503106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:50:58.503575 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.505008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.517786 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 882/1768] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:50:58.522226 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fca6-cb50-460d-ad32-4bb629046545 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.531867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fca6-cb50-460d-ad32-4bb629046545 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.536551 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91852b91-0ee5-43a5-8026-08b7182c7a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.537213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91852b91-0ee5-43a5-8026-08b7182c7a28 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.537499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91852b91-0ee5-43a5-8026-08b7182c7a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.538049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91852b91-0ee5-43a5-8026-08b7182c7a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.538748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91852b91-0ee5-43a5-8026-08b7182c7a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.540669 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91852b91-0ee5-43a5-8026-08b7182c7a28 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.571793 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 887/1769] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:58 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:58.574230 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.587781 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5e9e-aa45-4139-88fe-97f503a6fe5f admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.656621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b964e-c229-40ba-b7af-c89947118cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.657305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b964e-c229-40ba-b7af-c89947118cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.657594 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b964e-c229-40ba-b7af-c89947118cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.657909 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b964e-c229-40ba-b7af-c89947118cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.658600 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b964e-c229-40ba-b7af-c89947118cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.660572 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b964e-c229-40ba-b7af-c89947118cc2 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.688863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 883/1770] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:58 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:58.690320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91852b91-0ee5-43a5-8026-08b7182c7a28 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.702192 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91852b91-0ee5-43a5-8026-08b7182c7a28 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.707101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192c407-1e8a-4109-b7e7-4a49088b52a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.707823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192c407-1e8a-4109-b7e7-4a49088b52a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.708057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192c407-1e8a-4109-b7e7-4a49088b52a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.708341 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192c407-1e8a-4109-b7e7-4a49088b52a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.709400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192c407-1e8a-4109-b7e7-4a49088b52a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.711057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192c407-1e8a-4109-b7e7-4a49088b52a4 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.723944 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 888/1771] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:58.728287 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b964e-c229-40ba-b7af-c89947118cc2 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.740557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b964e-c229-40ba-b7af-c89947118cc2 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.746050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.746714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.747001 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.747280 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.748034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.749647 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.764543 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 884/1772] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:50:58.765652 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192c407-1e8a-4109-b7e7-4a49088b52a4 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.776839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192c407-1e8a-4109-b7e7-4a49088b52a4 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.783899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c4383-82fb-4e15-8b2a-926eafb4d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.788596 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c4383-82fb-4e15-8b2a-926eafb4d3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.788896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c4383-82fb-4e15-8b2a-926eafb4d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.789177 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c4383-82fb-4e15-8b2a-926eafb4d3d8 admin admin] PATH_INFO: `/v3/projects/e961837be53b409384f9a2c296b3fda0/users/0e63245708ce47a59bcb4bb23aee6bd3/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.811263 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c4383-82fb-4e15-8b2a-926eafb4d3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e961837be53b409384f9a2c296b3fda0, user_id=0e63245708ce47a59bcb4bb23aee6bd3, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.813985 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c4383-82fb-4e15-8b2a-926eafb4d3d8 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.822478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:58.824214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:58.827855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 889/1773] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:58 2022] PUT /identity/v3/projects/e961837be53b409384f9a2c296b3fda0/users/0e63245708ce47a59bcb4bb23aee6bd3/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:50:58.837315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650b34-b16c-419b-a30e-d9975c362166 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:58.837935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af24b-cfe4-499b-8176-faae17fb226e None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.838232 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af24b-cfe4-499b-8176-faae17fb226e None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.838514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af24b-cfe4-499b-8176-faae17fb226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.876838 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-659af24b-cfe4-499b-8176-faae17fb226e None None] MFA Rules not processed for user `0e63245708ce47a59bcb4bb23aee6bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:58.878410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-659af24b-cfe4-499b-8176-faae17fb226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:58.898323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:58.899313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:58.899671 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:58.900368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] PATH_INFO: `/v3/users/255c53c1a3134e4eac070a66fec7aa52` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:58.901541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255c53c1a3134e4eac070a66fec7aa52)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:58.903623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:58.966094 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255c53c1a3134e4eac070a66fec7aa52'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:58.968548 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:58.976941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255c53c1a3134e4eac070a66fec7aa52'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:58.981909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:58.994167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255c53c1a3134e4eac070a66fec7aa52'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:58.995500 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255c53c1a3134e4eac070a66fec7aa52'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:59.005289 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 890/1774] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:59.006465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-be758554-d8c8-4182-a351-30c30e42b476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255c53c1a3134e4eac070a66fec7aa52'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:50:59.010327 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af24b-cfe4-499b-8176-faae17fb226e None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.015147 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 885/1775] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:50:58 2022] DELETE /identity/v3/users/255c53c1a3134e4eac070a66fec7aa52 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:50:59.019701 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5786e-b5da-431b-a86a-0a4fc45e5689 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.020381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5786e-b5da-431b-a86a-0a4fc45e5689 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.020915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5786e-b5da-431b-a86a-0a4fc45e5689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.023616 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af24b-cfe4-499b-8176-faae17fb226e None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.050235 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-dfb5786e-b5da-431b-a86a-0a4fc45e5689 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:59.052239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-dfb5786e-b5da-431b-a86a-0a4fc45e5689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:59.099993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.101420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.101940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.102445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.103350 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.105484 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.144583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 891/1776] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:50:59 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:59.144583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.157198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 886/1777] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:59.159751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:59.166902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5786e-b5da-431b-a86a-0a4fc45e5689 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.168521 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-dfb5786e-b5da-431b-a86a-0a4fc45e5689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:59.279354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5786e-b5da-431b-a86a-0a4fc45e5689 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.298578 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6848c55-83b8-407b-b2c8-50d56763447c admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.303834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a038be-1f05-449f-834b-27e944b47821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.304877 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a038be-1f05-449f-834b-27e944b47821 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.305175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a038be-1f05-449f-834b-27e944b47821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.305461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a038be-1f05-449f-834b-27e944b47821 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.306202 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a038be-1f05-449f-834b-27e944b47821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.308218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a038be-1f05-449f-834b-27e944b47821 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.350178 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 892/1778] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:50:59 2022] POST /identity/v3/users => generated 307 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:50:59.354649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a038be-1f05-449f-834b-27e944b47821 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.378050 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a038be-1f05-449f-834b-27e944b47821 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.401022 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadc09e-2865-4ac8-aae7-3ce3e10072fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.401827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc09e-2865-4ac8-aae7-3ce3e10072fd service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.402209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc09e-2865-4ac8-aae7-3ce3e10072fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.402547 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc09e-2865-4ac8-aae7-3ce3e10072fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.408316 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5e559-a764-4f5b-83a0-2c04d428983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.411251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5e559-a764-4f5b-83a0-2c04d428983e admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.411251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5e559-a764-4f5b-83a0-2c04d428983e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.411251 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5e559-a764-4f5b-83a0-2c04d428983e admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.412028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5e559-a764-4f5b-83a0-2c04d428983e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.414574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5e559-a764-4f5b-83a0-2c04d428983e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.427731 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadc09e-2865-4ac8-aae7-3ce3e10072fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.431438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 893/1779] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:59.432377 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5e559-a764-4f5b-83a0-2c04d428983e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.433482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadc09e-2865-4ac8-aae7-3ce3e10072fd service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.443253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5e559-a764-4f5b-83a0-2c04d428983e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.448134 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264e768-140b-4c0e-bbd8-34b17957ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.449038 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264e768-140b-4c0e-bbd8-34b17957ed17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.449378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264e768-140b-4c0e-bbd8-34b17957ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.449665 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264e768-140b-4c0e-bbd8-34b17957ed17 admin admin] PATH_INFO: `/v3/projects/8c88301927c44fa19e68158198a4cd0a/users/7133fd8a98c340e5b4462689e3651e24/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.453397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 887/1780] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:50:59.467865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264e768-140b-4c0e-bbd8-34b17957ed17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c88301927c44fa19e68158198a4cd0a, user_id=7133fd8a98c340e5b4462689e3651e24, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.470601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264e768-140b-4c0e-bbd8-34b17957ed17 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.492312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 894/1781] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:59 2022] PUT /identity/v3/projects/8c88301927c44fa19e68158198a4cd0a/users/7133fd8a98c340e5b4462689e3651e24/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:50:59.493817 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadc09e-2865-4ac8-aae7-3ce3e10072fd service neutron] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.525158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadc09e-2865-4ac8-aae7-3ce3e10072fd service neutron] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.587693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:59.693916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7cd1f-2e11-4b6c-a1d0-d4a12af75b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.695264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7cd1f-2e11-4b6c-a1d0-d4a12af75b26 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.695613 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7cd1f-2e11-4b6c-a1d0-d4a12af75b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.695952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7cd1f-2e11-4b6c-a1d0-d4a12af75b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.696728 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7cd1f-2e11-4b6c-a1d0-d4a12af75b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.698498 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7cd1f-2e11-4b6c-a1d0-d4a12af75b26 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.713409 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 888/1782] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:50:59.717797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264e768-140b-4c0e-bbd8-34b17957ed17 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.730518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264e768-140b-4c0e-bbd8-34b17957ed17 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.736748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.738095 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.738631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.738942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] PATH_INFO: `/v3/projects/8c88301927c44fa19e68158198a4cd0a/users/7133fd8a98c340e5b4462689e3651e24/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.741231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c88301927c44fa19e68158198a4cd0a, user_id=7133fd8a98c340e5b4462689e3651e24, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:50:59.744081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:50:59.756463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 895/1783] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:50:59 2022] PUT /identity/v3/projects/8c88301927c44fa19e68158198a4cd0a/users/7133fd8a98c340e5b4462689e3651e24/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:50:59.767439 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292107-faeb-4a2c-8d14-1b06287b8ba2 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.767732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292107-faeb-4a2c-8d14-1b06287b8ba2 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.768017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292107-faeb-4a2c-8d14-1b06287b8ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:50:59.808367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-4c292107-faeb-4a2c-8d14-1b06287b8ba2 None None] MFA Rules not processed for user `7133fd8a98c340e5b4462689e3651e24`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:50:59.810031 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-4c292107-faeb-4a2c-8d14-1b06287b8ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:59.883272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 889/1784] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:50:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:50:59.893821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.896086 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:59.920271 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:50:59.935312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c292107-faeb-4a2c-8d14-1b06287b8ba2 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:50:59.936948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-4c292107-faeb-4a2c-8d14-1b06287b8ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:50:59.987320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da49c5-01fd-4076-81ac-ccec96872584 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:50:59.992415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ef342-9c43-4658-8fe3-54768b7ec5a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:50:59.993082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ef342-9c43-4658-8fe3-54768b7ec5a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:50:59.993368 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ef342-9c43-4658-8fe3-54768b7ec5a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:50:59.993857 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ef342-9c43-4658-8fe3-54768b7ec5a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.006476 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ef342-9c43-4658-8fe3-54768b7ec5a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.008654 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ef342-9c43-4658-8fe3-54768b7ec5a4 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.019481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c292107-faeb-4a2c-8d14-1b06287b8ba2 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.019650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 896/1785] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:50:59 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:00.024207 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.025081 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.025374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.025644 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] PATH_INFO: `/v3/projects/787c6571c61047dfb99c4ae663503641` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.026882 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=787c6571c61047dfb99c4ae663503641)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.028808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.083984 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '787c6571c61047dfb99c4ae663503641', 'request_id': 'req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.085151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:00.092255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '787c6571c61047dfb99c4ae663503641', 'request_id': 'req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.098682 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '787c6571c61047dfb99c4ae663503641', 'request_id': 'req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.111574 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] The token cache is being invalidate because project 787c6571c61047dfb99c4ae663503641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:00.111873 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.112591 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.114546 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 890/1786] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:50:59 2022] DELETE /identity/v3/projects/787c6571c61047dfb99c4ae663503641 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:00.119247 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ef342-9c43-4658-8fe3-54768b7ec5a4 service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.129892 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ef342-9c43-4658-8fe3-54768b7ec5a4 service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.188536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.189452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.189755 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.190048 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] PATH_INFO: `/v3/users/3dd5f8356fb344a5b964f815654500c6` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.191268 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd5f8356fb344a5b964f815654500c6)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.193213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.243973 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd5f8356fb344a5b964f815654500c6'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.250818 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd5f8356fb344a5b964f815654500c6'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.251435 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd5f8356fb344a5b964f815654500c6'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.259218 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd5f8356fb344a5b964f815654500c6'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.270917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-50b41114-ebd4-4f1d-89a8-523a918a45e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd5f8356fb344a5b964f815654500c6'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.277085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 897/1787] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:00 2022] DELETE /identity/v3/users/3dd5f8356fb344a5b964f815654500c6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:00.542365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.544069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:00.562224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cae49-8b72-4267-9f4a-ff3d739a2fd3 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.631579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.632507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.632791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.633067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] PATH_INFO: `/v3/projects/190279d13e7a4301b9f570fbfe544f2b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.634272 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=190279d13e7a4301b9f570fbfe544f2b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.636363 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.691459 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190279d13e7a4301b9f570fbfe544f2b', 'request_id': 'req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.701823 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190279d13e7a4301b9f570fbfe544f2b', 'request_id': 'req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.710926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190279d13e7a4301b9f570fbfe544f2b', 'request_id': 'req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.730857 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] The token cache is being invalidate because project 190279d13e7a4301b9f570fbfe544f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:00.731408 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.732259 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-45fdb017-2e6e-4446-9203-7ffe95e8ec3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:00.734498 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 891/1788] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:00 2022] DELETE /identity/v3/projects/190279d13e7a4301b9f570fbfe544f2b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:00.740416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889514-00d3-4223-ba31-147445fd9a8e None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.740895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889514-00d3-4223-ba31-147445fd9a8e None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.741426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889514-00d3-4223-ba31-147445fd9a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.771748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-dd889514-00d3-4223-ba31-147445fd9a8e None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:00.777904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-dd889514-00d3-4223-ba31-147445fd9a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:00.827155 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:00.866999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 898/1789] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:00.874898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dee80-2c3a-4bbe-ae65-7bf7fc940a38 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.875224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dee80-2c3a-4bbe-ae65-7bf7fc940a38 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.875541 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dee80-2c3a-4bbe-ae65-7bf7fc940a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.897057 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-453dee80-2c3a-4bbe-ae65-7bf7fc940a38 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:00.898849 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-453dee80-2c3a-4bbe-ae65-7bf7fc940a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:00.916807 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 892/1790] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:00.920807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889514-00d3-4223-ba31-147445fd9a8e None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.931491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889514-00d3-4223-ba31-147445fd9a8e None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.936835 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.937507 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.937830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.938112 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.938853 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:00.939221 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.940852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:00.952855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 899/1791] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:00.957186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dee80-2c3a-4bbe-ae65-7bf7fc940a38 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:00.974892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dee80-2c3a-4bbe-ae65-7bf7fc940a38 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:00.980759 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efed3-be65-4a32-919d-1915cdcd0f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:00.981490 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efed3-be65-4a32-919d-1915cdcd0f90 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:00.990029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efed3-be65-4a32-919d-1915cdcd0f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:00.990426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efed3-be65-4a32-919d-1915cdcd0f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:00.995172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394efed3-be65-4a32-919d-1915cdcd0f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:00.995172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394efed3-be65-4a32-919d-1915cdcd0f90 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.025990 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 893/1792] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:00 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:01.027461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.039314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa286a9-f228-4492-bee8-fb9494186b54 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.101298 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009db15-66ac-4f49-8985-eab40176ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.102041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009db15-66ac-4f49-8985-eab40176ec95 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.102330 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009db15-66ac-4f49-8985-eab40176ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.102614 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009db15-66ac-4f49-8985-eab40176ec95 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.103322 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009db15-66ac-4f49-8985-eab40176ec95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.105246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009db15-66ac-4f49-8985-eab40176ec95 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.132320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 900/1793] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:01 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:01.135991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efed3-be65-4a32-919d-1915cdcd0f90 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.145328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efed3-be65-4a32-919d-1915cdcd0f90 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.151083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653404-2b12-41d9-9a11-76817879f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.151779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653404-2b12-41d9-9a11-76817879f66e admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.152068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653404-2b12-41d9-9a11-76817879f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.152345 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653404-2b12-41d9-9a11-76817879f66e admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.153618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8653404-2b12-41d9-9a11-76817879f66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.155315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8653404-2b12-41d9-9a11-76817879f66e admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.170758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 894/1794] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:01.171608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009db15-66ac-4f49-8985-eab40176ec95 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.188640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009db15-66ac-4f49-8985-eab40176ec95 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.193697 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b481d-cb9f-415f-8e4e-5567c2d630e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.194908 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b481d-cb9f-415f-8e4e-5567c2d630e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.195195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b481d-cb9f-415f-8e4e-5567c2d630e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.195475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b481d-cb9f-415f-8e4e-5567c2d630e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.196212 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b481d-cb9f-415f-8e4e-5567c2d630e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.197859 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b481d-cb9f-415f-8e4e-5567c2d630e5 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.208681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 901/1795] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:01.213815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653404-2b12-41d9-9a11-76817879f66e admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.224649 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653404-2b12-41d9-9a11-76817879f66e admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.229327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3af62-98c7-44bf-b004-e8cbe817e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.230254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3af62-98c7-44bf-b004-e8cbe817e17e admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.230535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3af62-98c7-44bf-b004-e8cbe817e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.230821 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3af62-98c7-44bf-b004-e8cbe817e17e admin admin] PATH_INFO: `/v3/projects/73c2656890b54a409546cfe6997ca45d/users/650ed280d898451883ebbac91f495eb3/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.254579 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3af62-98c7-44bf-b004-e8cbe817e17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c2656890b54a409546cfe6997ca45d, user_id=650ed280d898451883ebbac91f495eb3, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.256319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3af62-98c7-44bf-b004-e8cbe817e17e admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.275358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 895/1796] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:01 2022] PUT /identity/v3/projects/73c2656890b54a409546cfe6997ca45d/users/650ed280d898451883ebbac91f495eb3/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:01.285511 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746186-57ac-42d0-9a7d-80d643b98415 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.286063 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746186-57ac-42d0-9a7d-80d643b98415 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.286657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746186-57ac-42d0-9a7d-80d643b98415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.315085 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-74746186-57ac-42d0-9a7d-80d643b98415 None None] MFA Rules not processed for user `650ed280d898451883ebbac91f495eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:01.316428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-74746186-57ac-42d0-9a7d-80d643b98415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:01.393630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 902/1797] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:01.399149 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3af62-98c7-44bf-b004-e8cbe817e17e admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.408315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:01.489485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3af62-98c7-44bf-b004-e8cbe817e17e admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.495680 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002c914-b1ed-42ae-b8ff-5f9c19866ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.496584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c914-b1ed-42ae-b8ff-5f9c19866ebe admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.497083 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c914-b1ed-42ae-b8ff-5f9c19866ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.497446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c914-b1ed-42ae-b8ff-5f9c19866ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.498266 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002c914-b1ed-42ae-b8ff-5f9c19866ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.500302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002c914-b1ed-42ae-b8ff-5f9c19866ebe admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.528744 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 896/1798] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:01 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:01.532122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74746186-57ac-42d0-9a7d-80d643b98415 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.542904 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74746186-57ac-42d0-9a7d-80d643b98415 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.578241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:01.608477 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2088-1d3c-44a4-9d07-fa01ded9010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.609151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2088-1d3c-44a4-9d07-fa01ded9010e admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.609438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2088-1d3c-44a4-9d07-fa01ded9010e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.609722 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2088-1d3c-44a4-9d07-fa01ded9010e admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.610447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a2088-1d3c-44a4-9d07-fa01ded9010e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.612371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a2088-1d3c-44a4-9d07-fa01ded9010e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.636561 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 903/1799] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:01 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:01.645144 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002c914-b1ed-42ae-b8ff-5f9c19866ebe admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.668014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002c914-b1ed-42ae-b8ff-5f9c19866ebe admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.673233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1604d-3637-45c4-bb61-e8a4d02eb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.673957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1604d-3637-45c4-bb61-e8a4d02eb519 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.674249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1604d-3637-45c4-bb61-e8a4d02eb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.674528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1604d-3637-45c4-bb61-e8a4d02eb519 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.675260 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1604d-3637-45c4-bb61-e8a4d02eb519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.676900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1604d-3637-45c4-bb61-e8a4d02eb519 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.689762 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 897/1800] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:01.692923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2088-1d3c-44a4-9d07-fa01ded9010e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.703502 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2088-1d3c-44a4-9d07-fa01ded9010e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.708491 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82400f7d-cef9-4ad9-a925-a3dccbb90aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.709389 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400f7d-cef9-4ad9-a925-a3dccbb90aee admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.709672 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400f7d-cef9-4ad9-a925-a3dccbb90aee admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.710073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400f7d-cef9-4ad9-a925-a3dccbb90aee admin admin] PATH_INFO: `/v3/projects/23b06c9687174980b88b7960684f46a3/users/dc9a152f04224cc4ae8433058e5c5d6a/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.728980 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82400f7d-cef9-4ad9-a925-a3dccbb90aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b06c9687174980b88b7960684f46a3, user_id=dc9a152f04224cc4ae8433058e5c5d6a, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.731823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82400f7d-cef9-4ad9-a925-a3dccbb90aee admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.761331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 904/1801] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:01 2022] PUT /identity/v3/projects/23b06c9687174980b88b7960684f46a3/users/dc9a152f04224cc4ae8433058e5c5d6a/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:01.765326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1604d-3637-45c4-bb61-e8a4d02eb519 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.777903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1604d-3637-45c4-bb61-e8a4d02eb519 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.848224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599c0db-fbe4-417d-a4e3-4b883f53db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.849109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c0db-fbe4-417d-a4e3-4b883f53db1f admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.849470 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c0db-fbe4-417d-a4e3-4b883f53db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.849926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c0db-fbe4-417d-a4e3-4b883f53db1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.851306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599c0db-fbe4-417d-a4e3-4b883f53db1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.852991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599c0db-fbe4-417d-a4e3-4b883f53db1f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.869331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 898/1802] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:01.870792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82400f7d-cef9-4ad9-a925-a3dccbb90aee admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:01.881359 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82400f7d-cef9-4ad9-a925-a3dccbb90aee admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:01.886145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:01.887041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.887419 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.887704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] PATH_INFO: `/v3/projects/23b06c9687174980b88b7960684f46a3/users/dc9a152f04224cc4ae8433058e5c5d6a/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.889899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b06c9687174980b88b7960684f46a3, user_id=dc9a152f04224cc4ae8433058e5c5d6a, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:01.896047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:01.909816 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 905/1803] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:01 2022] PUT /identity/v3/projects/23b06c9687174980b88b7960684f46a3/users/dc9a152f04224cc4ae8433058e5c5d6a/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:01.921477 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3ac4-544d-4332-a91d-18e9bd13c3d8 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:01.921791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3ac4-544d-4332-a91d-18e9bd13c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:01.922103 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3ac4-544d-4332-a91d-18e9bd13c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:01.951794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-247e3ac4-544d-4332-a91d-18e9bd13c3d8 None None] MFA Rules not processed for user `dc9a152f04224cc4ae8433058e5c5d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:01.953035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-247e3ac4-544d-4332-a91d-18e9bd13c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:02.026348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:02.033950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 899/1804] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:02.041593 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:02.043442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:02.103509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40408-8aeb-4072-8b1c-297f816f62d9 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:02.107157 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:02.107804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:02.108090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:02.108373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:02.118896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:02.120342 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:02.129947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 906/1805] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:02.222425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e3ac4-544d-4332-a91d-18e9bd13c3d8 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:02.232763 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e3ac4-544d-4332-a91d-18e9bd13c3d8 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:02.236329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd4cc8-af8b-4d52-835f-344b184bb433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:02.236977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4cc8-af8b-4d52-835f-344b184bb433 service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:02.237264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4cc8-af8b-4d52-835f-344b184bb433 service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:02.237544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4cc8-af8b-4d52-835f-344b184bb433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:02.301725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd4cc8-af8b-4d52-835f-344b184bb433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:02.303167 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd4cc8-af8b-4d52-835f-344b184bb433 service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:02.322099 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 900/1806] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:04.300313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.301914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:04.378326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d247d-bc2a-4af1-b8d6-2a8b89db0325 service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.387264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.388709 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.389040 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.389361 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] PATH_INFO: `/v3/users/0e63245708ce47a59bcb4bb23aee6bd3` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.390868 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e63245708ce47a59bcb4bb23aee6bd3)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.392924 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.434434 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:04.451839 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e63245708ce47a59bcb4bb23aee6bd3'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:04.462238 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e63245708ce47a59bcb4bb23aee6bd3'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:04.462999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e63245708ce47a59bcb4bb23aee6bd3'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:04.471271 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e63245708ce47a59bcb4bb23aee6bd3'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:04.486461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e63245708ce47a59bcb4bb23aee6bd3'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:04.493794 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 907/1807] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:04 2022] DELETE /identity/v3/users/0e63245708ce47a59bcb4bb23aee6bd3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:04.507864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820317bc-cc6c-4550-9501-b0b31a1c7c7b None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.508365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820317bc-cc6c-4550-9501-b0b31a1c7c7b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.508463 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820317bc-cc6c-4550-9501-b0b31a1c7c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.528519 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-820317bc-cc6c-4550-9501-b0b31a1c7c7b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:04.529838 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-820317bc-cc6c-4550-9501-b0b31a1c7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:04.603184 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 901/1808] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:04.615476 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.617531 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:04.676965 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfc092-09d1-46cb-b679-dfc548b0830e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.680644 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b2128-9d78-4789-9cbb-b4a2f6875f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.681294 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b2128-9d78-4789-9cbb-b4a2f6875f63 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.681576 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b2128-9d78-4789-9cbb-b4a2f6875f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.681905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b2128-9d78-4789-9cbb-b4a2f6875f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.690895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b2128-9d78-4789-9cbb-b4a2f6875f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.692340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b2128-9d78-4789-9cbb-b4a2f6875f63 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:04.702576 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 908/1809] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:04.973191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820317bc-cc6c-4550-9501-b0b31a1c7c7b None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:04.974633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-820317bc-cc6c-4550-9501-b0b31a1c7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:04.986714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820317bc-cc6c-4550-9501-b0b31a1c7c7b None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:04.991466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:04.992269 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:04.992631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:04.992894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] PATH_INFO: `/v3/projects/e961837be53b409384f9a2c296b3fda0` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:04.994165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e961837be53b409384f9a2c296b3fda0)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:04.996101 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.060109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e961837be53b409384f9a2c296b3fda0', 'request_id': 'req-e734e30e-50fe-4a78-957a-63cf232f3fcf'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.066808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e961837be53b409384f9a2c296b3fda0', 'request_id': 'req-e734e30e-50fe-4a78-957a-63cf232f3fcf'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.074529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e961837be53b409384f9a2c296b3fda0', 'request_id': 'req-e734e30e-50fe-4a78-957a-63cf232f3fcf'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.099931 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] The token cache is being invalidate because project e961837be53b409384f9a2c296b3fda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:05.100236 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.101131 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.104353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 902/1810] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:04 2022] DELETE /identity/v3/projects/e961837be53b409384f9a2c296b3fda0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:05.106639 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b2128-9d78-4789-9cbb-b4a2f6875f63 service neutron] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.116702 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b2128-9d78-4789-9cbb-b4a2f6875f63 service neutron] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.178911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.179705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.179986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.180262 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] PATH_INFO: `/v3/users/7133fd8a98c340e5b4462689e3651e24` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.181429 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7133fd8a98c340e5b4462689e3651e24)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.183398 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.229754 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7133fd8a98c340e5b4462689e3651e24'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.233312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:05.238742 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7133fd8a98c340e5b4462689e3651e24'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.239392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7133fd8a98c340e5b4462689e3651e24'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.249380 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7133fd8a98c340e5b4462689e3651e24'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.263598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-38ca4d16-f7a4-4a9d-96ca-6383238e3e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7133fd8a98c340e5b4462689e3651e24'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.269752 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 909/1811] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:05 2022] DELETE /identity/v3/users/7133fd8a98c340e5b4462689e3651e24 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:05.556337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.558061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:05.595637 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e30e-50fe-4a78-957a-63cf232f3fcf admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.627985 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:05.685119 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.686057 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.686356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.686664 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] PATH_INFO: `/v3/projects/8c88301927c44fa19e68158198a4cd0a` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.689359 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c88301927c44fa19e68158198a4cd0a)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:05.691388 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:05.755429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c88301927c44fa19e68158198a4cd0a', 'request_id': 'req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.763375 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c88301927c44fa19e68158198a4cd0a', 'request_id': 'req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.786893 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c88301927c44fa19e68158198a4cd0a', 'request_id': 'req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.822910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] The token cache is being invalidate because project 8c88301927c44fa19e68158198a4cd0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:05.823217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.823926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-255135d7-e3e8-46b0-aa68-4e06bf5d31f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:05.831490 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 903/1812] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:05 2022] DELETE /identity/v3/projects/8c88301927c44fa19e68158198a4cd0a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:05.832046 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1ed14-0edb-4907-986b-72dbb968456c None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.832814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1ed14-0edb-4907-986b-72dbb968456c None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.832814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1ed14-0edb-4907-986b-72dbb968456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.854446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-63b1ed14-0edb-4907-986b-72dbb968456c None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:05.855693 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-63b1ed14-0edb-4907-986b-72dbb968456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:05.924690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 910/1813] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:05.934282 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca8a2-20c6-40cd-b009-98b5ee2964dd None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.934656 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca8a2-20c6-40cd-b009-98b5ee2964dd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.935013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca8a2-20c6-40cd-b009-98b5ee2964dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.954129 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-935ca8a2-20c6-40cd-b009-98b5ee2964dd None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:05.955426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-935ca8a2-20c6-40cd-b009-98b5ee2964dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:05.964880 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 904/1814] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:05.979163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1ed14-0edb-4907-986b-72dbb968456c None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:05.990808 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1ed14-0edb-4907-986b-72dbb968456c None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:05.996042 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:05.997093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:05.997093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:05.997353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:05.998171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:05.998467 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.000200 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.018607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 911/1815] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:06.019850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ca8a2-20c6-40cd-b009-98b5ee2964dd None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.033071 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ca8a2-20c6-40cd-b009-98b5ee2964dd None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:06.039821 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:06.040506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.040791 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.041072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.041851 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.043780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.068645 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 905/1816] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:06 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:06.072817 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.083756 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93485-b9bd-4a3c-8ee9-fedd2c6960f0 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:06.143943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.147220 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:06.206336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749966-ddd6-4467-aa0e-0ad085657a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:06.211501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749966-ddd6-4467-aa0e-0ad085657a27 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.211887 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749966-ddd6-4467-aa0e-0ad085657a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.213410 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749966-ddd6-4467-aa0e-0ad085657a27 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.215117 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11749966-ddd6-4467-aa0e-0ad085657a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.222285 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11749966-ddd6-4467-aa0e-0ad085657a27 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.267038 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c8c27-250b-442e-ae38-53995dc25059 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:06.280446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeba680-64e3-4257-b112-e1c1ba3f9a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:06.282850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba680-64e3-4257-b112-e1c1ba3f9a43 service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.283435 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba680-64e3-4257-b112-e1c1ba3f9a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.284693 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba680-64e3-4257-b112-e1c1ba3f9a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.285289 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 912/1817] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:06 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:06.292003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749966-ddd6-4467-aa0e-0ad085657a27 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.292655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-bbeba680-64e3-4257-b112-e1c1ba3f9a43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:06.322370 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749966-ddd6-4467-aa0e-0ad085657a27 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:06.339628 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b60b78-eac8-45e8-8828-6a791a322771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:06.341295 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b60b78-eac8-45e8-8828-6a791a322771 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.343242 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b60b78-eac8-45e8-8828-6a791a322771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.343541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b60b78-eac8-45e8-8828-6a791a322771 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.346292 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b60b78-eac8-45e8-8828-6a791a322771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.350191 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b60b78-eac8-45e8-8828-6a791a322771 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.384928 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 913/1818] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:06.385962 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b60b78-eac8-45e8-8828-6a791a322771 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.397083 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b60b78-eac8-45e8-8828-6a791a322771 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:06.402685 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfafd8c-922c-45c6-b82f-2629bc98fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:06.404236 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfafd8c-922c-45c6-b82f-2629bc98fc0d admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.404529 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfafd8c-922c-45c6-b82f-2629bc98fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.404812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfafd8c-922c-45c6-b82f-2629bc98fc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.405556 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfafd8c-922c-45c6-b82f-2629bc98fc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.406676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:06.407979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfafd8c-922c-45c6-b82f-2629bc98fc0d admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.422447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 914/1819] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:06.426648 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfafd8c-922c-45c6-b82f-2629bc98fc0d admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.437558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfafd8c-922c-45c6-b82f-2629bc98fc0d admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:06.444710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ffa56-851f-43fc-8a34-f248f432937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:06.445627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ffa56-851f-43fc-8a34-f248f432937b admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.446302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ffa56-851f-43fc-8a34-f248f432937b admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.446302 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ffa56-851f-43fc-8a34-f248f432937b admin admin] PATH_INFO: `/v3/projects/bd3801d543894a2e90ffbe9ee4d31d7d/users/bc8f88048593425ca9b99fad5f4492d5/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.463264 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeba680-64e3-4257-b112-e1c1ba3f9a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.464720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeba680-64e3-4257-b112-e1c1ba3f9a43 service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.481008 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 906/1820] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:51:06.484572 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ffa56-851f-43fc-8a34-f248f432937b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3801d543894a2e90ffbe9ee4d31d7d, user_id=bc8f88048593425ca9b99fad5f4492d5, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.488963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ffa56-851f-43fc-8a34-f248f432937b admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.508725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:06.518082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 915/1821] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:06 2022] PUT /identity/v3/projects/bd3801d543894a2e90ffbe9ee4d31d7d/users/bc8f88048593425ca9b99fad5f4492d5/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:06.531329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5658-c309-4522-a0da-6dfc42fe4b7a None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.531795 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5658-c309-4522-a0da-6dfc42fe4b7a None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.532084 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5658-c309-4522-a0da-6dfc42fe4b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.587904 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-198c5658-c309-4522-a0da-6dfc42fe4b7a None None] MFA Rules not processed for user `bc8f88048593425ca9b99fad5f4492d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:06.590043 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-198c5658-c309-4522-a0da-6dfc42fe4b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:06.697900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 907/1822] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:06.700454 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ffa56-851f-43fc-8a34-f248f432937b admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.849364 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ffa56-851f-43fc-8a34-f248f432937b admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:06.854869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d8803-6ef1-4df1-920e-7290c2c54055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:06.855634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d8803-6ef1-4df1-920e-7290c2c54055 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:06.855996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d8803-6ef1-4df1-920e-7290c2c54055 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:06.856601 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d8803-6ef1-4df1-920e-7290c2c54055 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:06.857393 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d8803-6ef1-4df1-920e-7290c2c54055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:06.860764 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d8803-6ef1-4df1-920e-7290c2c54055 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:06.908420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 916/1823] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:06 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:06.909340 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c5658-c309-4522-a0da-6dfc42fe4b7a None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:06.937330 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c5658-c309-4522-a0da-6dfc42fe4b7a None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.093107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96780962-47f1-426e-9a8b-85817d3a769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.096188 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780962-47f1-426e-9a8b-85817d3a769b admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.096481 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780962-47f1-426e-9a8b-85817d3a769b admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.097391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780962-47f1-426e-9a8b-85817d3a769b admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.098223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96780962-47f1-426e-9a8b-85817d3a769b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.111705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96780962-47f1-426e-9a8b-85817d3a769b admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.170033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 908/1824] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:06 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:07.174867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d8803-6ef1-4df1-920e-7290c2c54055 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.192825 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d8803-6ef1-4df1-920e-7290c2c54055 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.208354 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56599776-75b9-4110-b3a7-7be7d0ee1ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.209416 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599776-75b9-4110-b3a7-7be7d0ee1ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.212197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599776-75b9-4110-b3a7-7be7d0ee1ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.212197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599776-75b9-4110-b3a7-7be7d0ee1ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.212197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56599776-75b9-4110-b3a7-7be7d0ee1ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.212706 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56599776-75b9-4110-b3a7-7be7d0ee1ac8 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.231521 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 917/1825] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:07.235842 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96780962-47f1-426e-9a8b-85817d3a769b admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.248132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96780962-47f1-426e-9a8b-85817d3a769b admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.255345 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4eb29-b279-42f3-9b83-3a7a96bc6b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.256772 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4eb29-b279-42f3-9b83-3a7a96bc6b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.257219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4eb29-b279-42f3-9b83-3a7a96bc6b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.257515 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4eb29-b279-42f3-9b83-3a7a96bc6b59 admin admin] PATH_INFO: `/v3/projects/7b5d0427b4eb4a81b3ad07b3e299cf6f/users/8a3399ed7f5548298bcbbc09c5c60eea/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.284368 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4eb29-b279-42f3-9b83-3a7a96bc6b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d0427b4eb4a81b3ad07b3e299cf6f, user_id=8a3399ed7f5548298bcbbc09c5c60eea, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.290212 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4eb29-b279-42f3-9b83-3a7a96bc6b59 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.319504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56599776-75b9-4110-b3a7-7be7d0ee1ac8 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.320030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 909/1826] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:07 2022] PUT /identity/v3/projects/7b5d0427b4eb4a81b3ad07b3e299cf6f/users/8a3399ed7f5548298bcbbc09c5c60eea/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:07.344436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56599776-75b9-4110-b3a7-7be7d0ee1ac8 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.438019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e49df-8d0c-4d00-b39e-e4df0951e891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.438851 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e49df-8d0c-4d00-b39e-e4df0951e891 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.439301 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e49df-8d0c-4d00-b39e-e4df0951e891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.439683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e49df-8d0c-4d00-b39e-e4df0951e891 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.440501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e49df-8d0c-4d00-b39e-e4df0951e891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.442482 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e49df-8d0c-4d00-b39e-e4df0951e891 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.459391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 918/1827] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:07.460455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4eb29-b279-42f3-9b83-3a7a96bc6b59 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.484014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4eb29-b279-42f3-9b83-3a7a96bc6b59 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.502874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.505375 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.505598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.506800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] PATH_INFO: `/v3/projects/7b5d0427b4eb4a81b3ad07b3e299cf6f/users/8a3399ed7f5548298bcbbc09c5c60eea/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.512513 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d0427b4eb4a81b3ad07b3e299cf6f, user_id=8a3399ed7f5548298bcbbc09c5c60eea, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.520994 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.555316 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 910/1828] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:07 2022] PUT /identity/v3/projects/7b5d0427b4eb4a81b3ad07b3e299cf6f/users/8a3399ed7f5548298bcbbc09c5c60eea/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:07.561299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f59d-ef74-45b9-830a-5eb5810925e9 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.561814 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f59d-ef74-45b9-830a-5eb5810925e9 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.562485 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f59d-ef74-45b9-830a-5eb5810925e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.588478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.590422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:07.616195 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:07.631021 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-b839f59d-ef74-45b9-830a-5eb5810925e9 None None] MFA Rules not processed for user `8a3399ed7f5548298bcbbc09c5c60eea`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:07.632795 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b839f59d-ef74-45b9-830a-5eb5810925e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:07.699616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668829a-6cfe-4309-b5e4-063afb8735ef admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.708300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.709688 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.710528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.710815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] PATH_INFO: `/v3/users/516bcb4d2c84486fa462519abe62f283` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.712089 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=516bcb4d2c84486fa462519abe62f283)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.715563 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.729438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:07.742227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 919/1829] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:07.756005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f59d-ef74-45b9-830a-5eb5810925e9 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.757986 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-b839f59d-ef74-45b9-830a-5eb5810925e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:07.784239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516bcb4d2c84486fa462519abe62f283'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:07.799091 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516bcb4d2c84486fa462519abe62f283'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:07.813690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516bcb4d2c84486fa462519abe62f283'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:07.815464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516bcb4d2c84486fa462519abe62f283'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:07.824903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-dde8ca2d-bf68-452a-9b70-3eb9ce0e9f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516bcb4d2c84486fa462519abe62f283'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:07.830953 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f59d-ef74-45b9-830a-5eb5810925e9 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:07.833544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 911/1830] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:07 2022] DELETE /identity/v3/users/516bcb4d2c84486fa462519abe62f283 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:07.836240 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:07.837636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.838105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.838541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.838951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d390a8-3cdc-46ba-8954-f6bf68a6e042 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:07.839319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d390a8-3cdc-46ba-8954-f6bf68a6e042 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:07.839675 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d390a8-3cdc-46ba-8954-f6bf68a6e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:07.841336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:07.856213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:07.858406 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:07.859249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-f9d390a8-3cdc-46ba-8954-f6bf68a6e042 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:07.860526 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-f9d390a8-3cdc-46ba-8954-f6bf68a6e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:07.870057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 920/1831] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:51:07.936926 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 912/1832] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:07.949320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:07.951165 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:08.045453 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36742-01f9-4766-b7a0-121ade2508d3 service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.128056 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09730fb-f54f-48de-b667-6880e6b9eb39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.128411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09730fb-f54f-48de-b667-6880e6b9eb39 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.128664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09730fb-f54f-48de-b667-6880e6b9eb39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.128947 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09730fb-f54f-48de-b667-6880e6b9eb39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.140509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09730fb-f54f-48de-b667-6880e6b9eb39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.142008 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09730fb-f54f-48de-b667-6880e6b9eb39 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.154573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 921/1833] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:08.338174 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d390a8-3cdc-46ba-8954-f6bf68a6e042 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.339639 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-f9d390a8-3cdc-46ba-8954-f6bf68a6e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:08.354578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d390a8-3cdc-46ba-8954-f6bf68a6e042 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.360698 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.361622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.361849 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.362108 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] PATH_INFO: `/v3/users/bc8f88048593425ca9b99fad5f4492d5` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.363519 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8f88048593425ca9b99fad5f4492d5)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.366900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.425197 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:08.444864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8f88048593425ca9b99fad5f4492d5'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.460251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8f88048593425ca9b99fad5f4492d5'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.488720 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8f88048593425ca9b99fad5f4492d5'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.490039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8f88048593425ca9b99fad5f4492d5'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.501790 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8f88048593425ca9b99fad5f4492d5'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.511949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 913/1834] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:08 2022] DELETE /identity/v3/users/bc8f88048593425ca9b99fad5f4492d5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:08.516270 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a5d2d-486c-40b5-99cb-29bc4b88c146 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.516568 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a5d2d-486c-40b5-99cb-29bc4b88c146 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.517437 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a5d2d-486c-40b5-99cb-29bc4b88c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.547930 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-659a5d2d-486c-40b5-99cb-29bc4b88c146 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:08.549272 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-659a5d2d-486c-40b5-99cb-29bc4b88c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:08.621197 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:08.634636 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 922/1835] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:08.645301 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.648023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:08.729712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885ee3-8989-4e69-b240-43c26b73b384 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.733943 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51290ab0-4bec-4108-9102-68019aa828a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.736734 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290ab0-4bec-4108-9102-68019aa828a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.737069 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290ab0-4bec-4108-9102-68019aa828a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.737507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290ab0-4bec-4108-9102-68019aa828a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.760311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51290ab0-4bec-4108-9102-68019aa828a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.764479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51290ab0-4bec-4108-9102-68019aa828a4 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.780302 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 914/1836] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:08.807562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a5d2d-486c-40b5-99cb-29bc4b88c146 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.809171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-659a5d2d-486c-40b5-99cb-29bc4b88c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:08.834739 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a5d2d-486c-40b5-99cb-29bc4b88c146 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:08.849524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:08.851405 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:08.851778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:08.852424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] PATH_INFO: `/v3/projects/ecb1f2e091134255937cc5ccce94af74` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:08.855332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb1f2e091134255937cc5ccce94af74)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:08.859750 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:08.930518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb1f2e091134255937cc5ccce94af74', 'request_id': 'req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.937898 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb1f2e091134255937cc5ccce94af74', 'request_id': 'req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.945009 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb1f2e091134255937cc5ccce94af74', 'request_id': 'req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.959181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] The token cache is being invalidate because project ecb1f2e091134255937cc5ccce94af74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:08.959501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.961387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:08.963163 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 923/1837] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:08 2022] DELETE /identity/v3/projects/ecb1f2e091134255937cc5ccce94af74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:08.967332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51290ab0-4bec-4108-9102-68019aa828a4 service neutron] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:08.985638 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51290ab0-4bec-4108-9102-68019aa828a4 service neutron] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.045294 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.046338 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.046623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.046903 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] PATH_INFO: `/v3/users/cd42c63e58dd44df8bde90b90458f66f` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.048085 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd42c63e58dd44df8bde90b90458f66f)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.050061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.101836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd42c63e58dd44df8bde90b90458f66f'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.105020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.106889 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:09.110066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.114578 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd42c63e58dd44df8bde90b90458f66f'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.147795 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39760-ebe5-4941-82b7-d57dbb2a2fd7 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.150495 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd42c63e58dd44df8bde90b90458f66f'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.151353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd42c63e58dd44df8bde90b90458f66f'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.158970 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.161274 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.161711 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.164992 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] PATH_INFO: `/v3/projects/bd3801d543894a2e90ffbe9ee4d31d7d` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.166493 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3801d543894a2e90ffbe9ee4d31d7d)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.168443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.170942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd42c63e58dd44df8bde90b90458f66f'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.180310 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 915/1838] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:08 2022] DELETE /identity/v3/users/cd42c63e58dd44df8bde90b90458f66f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:09.223205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3801d543894a2e90ffbe9ee4d31d7d', 'request_id': 'req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.231093 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3801d543894a2e90ffbe9ee4d31d7d', 'request_id': 'req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.238099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3801d543894a2e90ffbe9ee4d31d7d', 'request_id': 'req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.253156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] The token cache is being invalidate because project bd3801d543894a2e90ffbe9ee4d31d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:09.253475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.254271 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.257356 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 924/1839] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:09 2022] DELETE /identity/v3/projects/bd3801d543894a2e90ffbe9ee4d31d7d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:09.260940 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.262509 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:09.340381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f2388-ba75-4c88-be32-a1af9f09f8ec admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.400284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.401176 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.401465 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.401753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] PATH_INFO: `/v3/users/8a3399ed7f5548298bcbbc09c5c60eea` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.402979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3399ed7f5548298bcbbc09c5c60eea)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.404929 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.462011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.463553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:09.464490 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3399ed7f5548298bcbbc09c5c60eea'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.472745 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3399ed7f5548298bcbbc09c5c60eea'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.488865 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3399ed7f5548298bcbbc09c5c60eea'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.489637 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3399ed7f5548298bcbbc09c5c60eea'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.492366 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202afb7-9f7d-49c4-b4d6-5f39216b3f2e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.494336 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.498962 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.500171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.500518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.500866 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] PATH_INFO: `/v3/projects/a1dd64ac10fb4cd2af445698d88cdb51` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.501491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-326c6901-f3e7-4d36-91b4-48e487ec846c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3399ed7f5548298bcbbc09c5c60eea'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.502424 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1dd64ac10fb4cd2af445698d88cdb51)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.504996 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.510199 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 916/1840] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:09 2022] DELETE /identity/v3/users/8a3399ed7f5548298bcbbc09c5c60eea => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:09.576340 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1dd64ac10fb4cd2af445698d88cdb51', 'request_id': 'req-30e311a7-b9bd-4d84-a127-da770324e11b'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.587186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1dd64ac10fb4cd2af445698d88cdb51', 'request_id': 'req-30e311a7-b9bd-4d84-a127-da770324e11b'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.593824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:09.597089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1dd64ac10fb4cd2af445698d88cdb51', 'request_id': 'req-30e311a7-b9bd-4d84-a127-da770324e11b'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.624552 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] The token cache is being invalidate because project a1dd64ac10fb4cd2af445698d88cdb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:09.624922 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.625687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-30e311a7-b9bd-4d84-a127-da770324e11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.627602 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 925/1841] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:09 2022] DELETE /identity/v3/projects/a1dd64ac10fb4cd2af445698d88cdb51 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:09.632351 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d6d7-15b6-4451-990e-aef38c3dc031 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.632633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d6d7-15b6-4451-990e-aef38c3dc031 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.632930 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d6d7-15b6-4451-990e-aef38c3dc031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.651213 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-4596d6d7-15b6-4451-990e-aef38c3dc031 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:09.652440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-4596d6d7-15b6-4451-990e-aef38c3dc031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:09.714972 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 917/1842] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:09.723028 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25857b-fdc4-4620-9121-8b20116a0a15 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.723325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25857b-fdc4-4620-9121-8b20116a0a15 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.723608 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25857b-fdc4-4620-9121-8b20116a0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.742974 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9e25857b-fdc4-4620-9121-8b20116a0a15 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:09.744226 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9e25857b-fdc4-4620-9121-8b20116a0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:09.752686 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 926/1843] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:09.756934 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596d6d7-15b6-4451-990e-aef38c3dc031 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.766876 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596d6d7-15b6-4451-990e-aef38c3dc031 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.771969 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.773195 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.773482 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.773773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.774522 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:09.774832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.776474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.793124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 918/1844] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:09.799514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25857b-fdc4-4620-9121-8b20116a0a15 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.810544 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25857b-fdc4-4620-9121-8b20116a0a15 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.814469 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.816621 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:09.820062 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a3c72-596d-4cc6-84fe-5aa5c01726bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.820248 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a3c72-596d-4cc6-84fe-5aa5c01726bc admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.820506 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a3c72-596d-4cc6-84fe-5aa5c01726bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.820792 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a3c72-596d-4cc6-84fe-5aa5c01726bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.821500 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a3c72-596d-4cc6-84fe-5aa5c01726bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.831093 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d43da-c700-41f6-ab12-3bd5c49df431 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.831225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a3c72-596d-4cc6-84fe-5aa5c01726bc admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.837255 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:09.837698 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.838068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.838296 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] PATH_INFO: `/v3/projects/7b5d0427b4eb4a81b3ad07b3e299cf6f` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.839523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5d0427b4eb4a81b3ad07b3e299cf6f)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:09.841622 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:09.870202 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 927/1845] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:09 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:09.874067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a3c72-596d-4cc6-84fe-5aa5c01726bc admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:09.902050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5d0427b4eb4a81b3ad07b3e299cf6f', 'request_id': 'req-af07cd11-1806-4334-b2cd-bf39e18dda09'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.910602 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5d0427b4eb4a81b3ad07b3e299cf6f', 'request_id': 'req-af07cd11-1806-4334-b2cd-bf39e18dda09'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.918433 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5d0427b4eb4a81b3ad07b3e299cf6f', 'request_id': 'req-af07cd11-1806-4334-b2cd-bf39e18dda09'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.935480 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] The token cache is being invalidate because project 7b5d0427b4eb4a81b3ad07b3e299cf6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:09.936060 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.937014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-af07cd11-1806-4334-b2cd-bf39e18dda09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:09.939109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 919/1846] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:09 2022] DELETE /identity/v3/projects/7b5d0427b4eb4a81b3ad07b3e299cf6f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:09.944268 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865802a-a4ca-4fc4-b170-2d7cac8aeac3 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:09.944831 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865802a-a4ca-4fc4-b170-2d7cac8aeac3 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:09.945421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865802a-a4ca-4fc4-b170-2d7cac8aeac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:09.957041 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a3c72-596d-4cc6-84fe-5aa5c01726bc admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:09.970905 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-a865802a-a4ca-4fc4-b170-2d7cac8aeac3 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:09.972533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a865802a-a4ca-4fc4-b170-2d7cac8aeac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:10.018346 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.019060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.019353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.019694 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.020627 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.023673 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.048186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 928/1847] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:09 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:10.052606 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.054885 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:10.060597 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 920/1848] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:10.069148 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c184c8-ef55-41f3-af3b-7c914ccb1459 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.069337 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9b9b-27a5-4972-b6df-26d84a84d0d7 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.071412 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9b9b-27a5-4972-b6df-26d84a84d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.072322 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9b9b-27a5-4972-b6df-26d84a84d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.076418 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33981-938b-45e8-b4a6-19cd1a213710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.076914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33981-938b-45e8-b4a6-19cd1a213710 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.077213 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33981-938b-45e8-b4a6-19cd1a213710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.077501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33981-938b-45e8-b4a6-19cd1a213710 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.078282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33981-938b-45e8-b4a6-19cd1a213710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.090623 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33981-938b-45e8-b4a6-19cd1a213710 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.091237 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.100035 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-dbfc9b9b-27a5-4972-b6df-26d84a84d0d7 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:10.101902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-dbfc9b9b-27a5-4972-b6df-26d84a84d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:10.103681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 929/1849] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:10.107254 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33981-938b-45e8-b4a6-19cd1a213710 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.115006 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 921/1850] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:10.121919 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33981-938b-45e8-b4a6-19cd1a213710 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.123249 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc9b9b-27a5-4972-b6df-26d84a84d0d7 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.126660 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e48cd-47eb-487b-a6ba-1c965f731df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.127343 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48cd-47eb-487b-a6ba-1c965f731df6 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.127634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48cd-47eb-487b-a6ba-1c965f731df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.127918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48cd-47eb-487b-a6ba-1c965f731df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.128656 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e48cd-47eb-487b-a6ba-1c965f731df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.130346 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e48cd-47eb-487b-a6ba-1c965f731df6 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.133157 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc9b9b-27a5-4972-b6df-26d84a84d0d7 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.138537 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.139200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.139479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.139757 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.140478 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:10.140787 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.142545 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 930/1851] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:10.142657 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.146581 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e48cd-47eb-487b-a6ba-1c965f731df6 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.155028 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 922/1852] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:10.157008 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e48cd-47eb-487b-a6ba-1c965f731df6 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.159210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.162141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83972b24-3762-469a-95a6-a5a68e901ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.163059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972b24-3762-469a-95a6-a5a68e901ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.163344 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972b24-3762-469a-95a6-a5a68e901ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.163625 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972b24-3762-469a-95a6-a5a68e901ab3 admin admin] PATH_INFO: `/v3/projects/ecf75bcdeadc4c88a4fc8840b8642a5e/users/78ccd655c4b140aa9f7d7a61b117a7ec/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.169228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64588b-4d88-4178-b39f-58e8cad48b49 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.177198 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16f1ea-bdff-4ac3-ad8e-e998a4c1af3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.177916 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16f1ea-bdff-4ac3-ad8e-e998a4c1af3e admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.178218 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16f1ea-bdff-4ac3-ad8e-e998a4c1af3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.178533 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16f1ea-bdff-4ac3-ad8e-e998a4c1af3e admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.179227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16f1ea-bdff-4ac3-ad8e-e998a4c1af3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.179798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972b24-3762-469a-95a6-a5a68e901ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf75bcdeadc4c88a4fc8840b8642a5e, user_id=78ccd655c4b140aa9f7d7a61b117a7ec, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.181221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16f1ea-bdff-4ac3-ad8e-e998a4c1af3e admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.183897 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972b24-3762-469a-95a6-a5a68e901ab3 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.199821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 931/1853] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:10 2022] PUT /identity/v3/projects/ecf75bcdeadc4c88a4fc8840b8642a5e/users/78ccd655c4b140aa9f7d7a61b117a7ec/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:10.211695 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7bca-d8ed-490a-a160-df1cebbf7d6b None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.211993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7bca-d8ed-490a-a160-df1cebbf7d6b None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.212281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7bca-d8ed-490a-a160-df1cebbf7d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.212938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 923/1854] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:10.217390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16f1ea-bdff-4ac3-ad8e-e998a4c1af3e admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.234464 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.248730 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-84ef7bca-d8ed-490a-a160-df1cebbf7d6b None None] MFA Rules not processed for user `78ccd655c4b140aa9f7d7a61b117a7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:10.250546 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-84ef7bca-d8ed-490a-a160-df1cebbf7d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:10.288995 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16f1ea-bdff-4ac3-ad8e-e998a4c1af3e admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.298185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460fef5-6c83-45d6-afad-a18e40a388e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.299440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460fef5-6c83-45d6-afad-a18e40a388e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.299704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460fef5-6c83-45d6-afad-a18e40a388e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.300066 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460fef5-6c83-45d6-afad-a18e40a388e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.300784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460fef5-6c83-45d6-afad-a18e40a388e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.302785 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460fef5-6c83-45d6-afad-a18e40a388e7 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.323051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 932/1855] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:10.327510 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7bca-d8ed-490a-a160-df1cebbf7d6b None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.328558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 924/1856] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/users => generated 279 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:10.334827 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460fef5-6c83-45d6-afad-a18e40a388e7 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.340693 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7bca-d8ed-490a-a160-df1cebbf7d6b None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.346372 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460fef5-6c83-45d6-afad-a18e40a388e7 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.346633 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d3ac-1204-4323-9c69-e5d843b98b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.347413 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d3ac-1204-4323-9c69-e5d843b98b52 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.347683 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d3ac-1204-4323-9c69-e5d843b98b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.348054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d3ac-1204-4323-9c69-e5d843b98b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.348900 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81d3ac-1204-4323-9c69-e5d843b98b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.351105 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81d3ac-1204-4323-9c69-e5d843b98b52 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.351473 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93506d53-f109-48c4-9592-f47e25f48d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.352148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93506d53-f109-48c4-9592-f47e25f48d16 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.352440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93506d53-f109-48c4-9592-f47e25f48d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.352725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93506d53-f109-48c4-9592-f47e25f48d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.353776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93506d53-f109-48c4-9592-f47e25f48d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.355749 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93506d53-f109-48c4-9592-f47e25f48d16 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.366344 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 925/1857] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:10.370357 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93506d53-f109-48c4-9592-f47e25f48d16 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.380810 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93506d53-f109-48c4-9592-f47e25f48d16 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.385107 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 933/1858] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:10.386996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6bb39-6e59-4db3-8cb0-ee0d357ee18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.387672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6bb39-6e59-4db3-8cb0-ee0d357ee18d admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.387968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6bb39-6e59-4db3-8cb0-ee0d357ee18d admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.388263 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6bb39-6e59-4db3-8cb0-ee0d357ee18d admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.389037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6bb39-6e59-4db3-8cb0-ee0d357ee18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.389539 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d3ac-1204-4323-9c69-e5d843b98b52 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.390764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6bb39-6e59-4db3-8cb0-ee0d357ee18d admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.402499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 926/1859] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:10.406496 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6bb39-6e59-4db3-8cb0-ee0d357ee18d admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.416530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6bb39-6e59-4db3-8cb0-ee0d357ee18d admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.475607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d3ac-1204-4323-9c69-e5d843b98b52 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.480687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dc78b-4f93-4e3f-b78f-1bbb66146184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.481423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dc78b-4f93-4e3f-b78f-1bbb66146184 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.481700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dc78b-4f93-4e3f-b78f-1bbb66146184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.482011 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dc78b-4f93-4e3f-b78f-1bbb66146184 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.482719 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dc78b-4f93-4e3f-b78f-1bbb66146184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.484657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dc78b-4f93-4e3f-b78f-1bbb66146184 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.488923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7ac8c-43b5-4624-a1e2-5911992a1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.489952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7ac8c-43b5-4624-a1e2-5911992a1b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.490245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7ac8c-43b5-4624-a1e2-5911992a1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.490532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7ac8c-43b5-4624-a1e2-5911992a1b4d admin admin] PATH_INFO: `/v3/projects/fbcb639cea594fbc9239aaf86997bd2b/users/4f3e1783524b45c39cbcb8ed4fe17b56/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.506154 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 934/1860] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:10.507527 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7ac8c-43b5-4624-a1e2-5911992a1b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcb639cea594fbc9239aaf86997bd2b, user_id=4f3e1783524b45c39cbcb8ed4fe17b56, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.510300 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7ac8c-43b5-4624-a1e2-5911992a1b4d admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.510573 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dc78b-4f93-4e3f-b78f-1bbb66146184 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.521501 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dc78b-4f93-4e3f-b78f-1bbb66146184 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.526191 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 927/1861] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:10 2022] PUT /identity/v3/projects/fbcb639cea594fbc9239aaf86997bd2b/users/4f3e1783524b45c39cbcb8ed4fe17b56/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:10.536392 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184c8b-a15c-4f14-a0fe-d2b57a6809f3 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.536692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184c8b-a15c-4f14-a0fe-d2b57a6809f3 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.536977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184c8b-a15c-4f14-a0fe-d2b57a6809f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.563055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-16184c8b-a15c-4f14-a0fe-d2b57a6809f3 None None] MFA Rules not processed for user `4f3e1783524b45c39cbcb8ed4fe17b56`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:10.564214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-16184c8b-a15c-4f14-a0fe-d2b57a6809f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:10.568318 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.582570 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474892cd-7bde-4855-a956-17c2e8153d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.583383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474892cd-7bde-4855-a956-17c2e8153d6a admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.583786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474892cd-7bde-4855-a956-17c2e8153d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.584107 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474892cd-7bde-4855-a956-17c2e8153d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.585188 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474892cd-7bde-4855-a956-17c2e8153d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.587113 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474892cd-7bde-4855-a956-17c2e8153d6a admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.598123 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 935/1862] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:10.602311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474892cd-7bde-4855-a956-17c2e8153d6a admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.607522 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.614439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474892cd-7bde-4855-a956-17c2e8153d6a admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.620186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9eb4-1b51-4326-b458-4a303c0e0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.621077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9eb4-1b51-4326-b458-4a303c0e0564 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.621357 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9eb4-1b51-4326-b458-4a303c0e0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.621821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9eb4-1b51-4326-b458-4a303c0e0564 admin admin] PATH_INFO: `/v3/projects/5d884d7c3d634c9882fc84bf9f15812d/users/a49502662aa64b619ec2522111145f40/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.637556 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 928/1863] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:10.641154 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d9eb4-1b51-4326-b458-4a303c0e0564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d884d7c3d634c9882fc84bf9f15812d, user_id=a49502662aa64b619ec2522111145f40, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.642050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184c8b-a15c-4f14-a0fe-d2b57a6809f3 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.643821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d9eb4-1b51-4326-b458-4a303c0e0564 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.653529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184c8b-a15c-4f14-a0fe-d2b57a6809f3 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.658993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 936/1864] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:10 2022] PUT /identity/v3/projects/5d884d7c3d634c9882fc84bf9f15812d/users/a49502662aa64b619ec2522111145f40/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:10.662883 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9eb4-1b51-4326-b458-4a303c0e0564 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.712584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c19873-b0c2-4d68-b62b-d783e7fd2dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.713257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c19873-b0c2-4d68-b62b-d783e7fd2dbb admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.713590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c19873-b0c2-4d68-b62b-d783e7fd2dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.713976 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c19873-b0c2-4d68-b62b-d783e7fd2dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.714662 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c19873-b0c2-4d68-b62b-d783e7fd2dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.716590 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c19873-b0c2-4d68-b62b-d783e7fd2dbb admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.725662 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9eb4-1b51-4326-b458-4a303c0e0564 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.730867 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86c476-834b-410f-a795-350b4e20367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.731979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c476-834b-410f-a795-350b4e20367e admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.732338 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c476-834b-410f-a795-350b4e20367e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.732688 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c476-834b-410f-a795-350b4e20367e admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.733757 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86c476-834b-410f-a795-350b4e20367e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.735823 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86c476-834b-410f-a795-350b4e20367e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.745423 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 929/1865] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:10.746461 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c19873-b0c2-4d68-b62b-d783e7fd2dbb admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.747282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 937/1866] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:10.752533 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86c476-834b-410f-a795-350b4e20367e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.762855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86c476-834b-410f-a795-350b4e20367e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.808960 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c19873-b0c2-4d68-b62b-d783e7fd2dbb admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.813800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719325a-d89d-4be4-bdb7-02ea549e3036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.814425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719325a-d89d-4be4-bdb7-02ea549e3036 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.814735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719325a-d89d-4be4-bdb7-02ea549e3036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.815007 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719325a-d89d-4be4-bdb7-02ea549e3036 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.815698 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719325a-d89d-4be4-bdb7-02ea549e3036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.817678 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719325a-d89d-4be4-bdb7-02ea549e3036 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.824317 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218368e-bd99-451f-a0ae-c2e56d96d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.825231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218368e-bd99-451f-a0ae-c2e56d96d4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.825519 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218368e-bd99-451f-a0ae-c2e56d96d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.825830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218368e-bd99-451f-a0ae-c2e56d96d4ba admin admin] PATH_INFO: `/v3/projects/5d884d7c3d634c9882fc84bf9f15812d/users/a49502662aa64b619ec2522111145f40/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.827847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218368e-bd99-451f-a0ae-c2e56d96d4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d884d7c3d634c9882fc84bf9f15812d, user_id=a49502662aa64b619ec2522111145f40, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.831436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218368e-bd99-451f-a0ae-c2e56d96d4ba admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.841017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 930/1867] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:10.842248 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 938/1868] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:10 2022] PUT /identity/v3/projects/5d884d7c3d634c9882fc84bf9f15812d/users/a49502662aa64b619ec2522111145f40/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:10.842413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719325a-d89d-4be4-bdb7-02ea549e3036 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.852773 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f692800-3746-47bb-b9c2-6431fc0c83e8 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.852946 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719325a-d89d-4be4-bdb7-02ea549e3036 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.853099 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f692800-3746-47bb-b9c2-6431fc0c83e8 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.853375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f692800-3746-47bb-b9c2-6431fc0c83e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.872305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.882061 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-9f692800-3746-47bb-b9c2-6431fc0c83e8 None None] MFA Rules not processed for user `a49502662aa64b619ec2522111145f40`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:10.883830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9f692800-3746-47bb-b9c2-6431fc0c83e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:10.924490 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aceda-e750-49c3-90a2-a7e7efc2a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.925973 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aceda-e750-49c3-90a2-a7e7efc2a093 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.926273 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aceda-e750-49c3-90a2-a7e7efc2a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.926558 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aceda-e750-49c3-90a2-a7e7efc2a093 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.927297 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1aceda-e750-49c3-90a2-a7e7efc2a093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.929524 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1aceda-e750-49c3-90a2-a7e7efc2a093 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.940778 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 931/1869] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:10.944998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aceda-e750-49c3-90a2-a7e7efc2a093 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.951936 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:10.954884 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aceda-e750-49c3-90a2-a7e7efc2a093 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:10.959874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10166d07-ec2e-42f4-9ab1-48395af9f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:10.960984 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166d07-ec2e-42f4-9ab1-48395af9f13a admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:10.961407 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166d07-ec2e-42f4-9ab1-48395af9f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:10.961919 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166d07-ec2e-42f4-9ab1-48395af9f13a admin admin] PATH_INFO: `/v3/projects/4927cb1b841241e49b0754be027183c7/users/3c31319a5288494c9c1d6e29fbe67b85/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:10.966450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 939/1870] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:10.979821 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f692800-3746-47bb-b9c2-6431fc0c83e8 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:10.980634 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166d07-ec2e-42f4-9ab1-48395af9f13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4927cb1b841241e49b0754be027183c7, user_id=3c31319a5288494c9c1d6e29fbe67b85, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:10.981657 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9f692800-3746-47bb-b9c2-6431fc0c83e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:10.983364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166d07-ec2e-42f4-9ab1-48395af9f13a admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:10.998818 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 932/1871] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:10 2022] PUT /identity/v3/projects/4927cb1b841241e49b0754be027183c7/users/3c31319a5288494c9c1d6e29fbe67b85/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:11.002592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10166d07-ec2e-42f4-9ab1-48395af9f13a admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.043092 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f692800-3746-47bb-b9c2-6431fc0c83e8 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.064932 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10166d07-ec2e-42f4-9ab1-48395af9f13a admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.070397 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b833614-cfb2-4dd0-a54c-3b5d70d60f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.071067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833614-cfb2-4dd0-a54c-3b5d70d60f35 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.071352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833614-cfb2-4dd0-a54c-3b5d70d60f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.071633 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833614-cfb2-4dd0-a54c-3b5d70d60f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.072355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b833614-cfb2-4dd0-a54c-3b5d70d60f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.073996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b833614-cfb2-4dd0-a54c-3b5d70d60f35 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.083780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 933/1872] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:11.087967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b833614-cfb2-4dd0-a54c-3b5d70d60f35 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.093051 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.093863 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.094151 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.094428 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.101572 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b833614-cfb2-4dd0-a54c-3b5d70d60f35 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.107254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d01d9-6dd0-407c-ba7b-8c344edef48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.108421 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d01d9-6dd0-407c-ba7b-8c344edef48b admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.108716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d01d9-6dd0-407c-ba7b-8c344edef48b admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.110315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d01d9-6dd0-407c-ba7b-8c344edef48b admin admin] PATH_INFO: `/v3/projects/4927cb1b841241e49b0754be027183c7/users/3c31319a5288494c9c1d6e29fbe67b85/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.111474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d01d9-6dd0-407c-ba7b-8c344edef48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4927cb1b841241e49b0754be027183c7, user_id=3c31319a5288494c9c1d6e29fbe67b85, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.114384 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d01d9-6dd0-407c-ba7b-8c344edef48b admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.126171 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 934/1873] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:11 2022] PUT /identity/v3/projects/4927cb1b841241e49b0754be027183c7/users/3c31319a5288494c9c1d6e29fbe67b85/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:11.137612 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffd76-0aca-4217-9234-456d78fd7889 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.138017 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffd76-0aca-4217-9234-456d78fd7889 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.138265 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffd76-0aca-4217-9234-456d78fd7889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.172449 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.174069 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.177410 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-d5cffd76-0aca-4217-9234-456d78fd7889 None None] MFA Rules not processed for user `3c31319a5288494c9c1d6e29fbe67b85`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:11.179833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-d5cffd76-0aca-4217-9234-456d78fd7889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:11.187157 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 940/1874] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:11.261281 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:11.268492 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 935/1875] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:11.279108 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.280774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:11.293700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d795d-85b4-4c04-94b0-4c20fae8d95d service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.346279 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cffd76-0aca-4217-9234-456d78fd7889 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.356436 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2c67d-0117-4424-928e-96188e137a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.357116 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c67d-0117-4424-928e-96188e137a42 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.357409 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c67d-0117-4424-928e-96188e137a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.357692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c67d-0117-4424-928e-96188e137a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.367852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2c67d-0117-4424-928e-96188e137a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.369309 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2c67d-0117-4424-928e-96188e137a42 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.381438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 941/1876] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:11.428254 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cffd76-0aca-4217-9234-456d78fd7889 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.434097 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.435136 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.435499 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.435859 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] PATH_INFO: `/v3/users/78ccd655c4b140aa9f7d7a61b117a7ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.437208 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ccd655c4b140aa9f7d7a61b117a7ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.439319 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.476655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2c67d-0117-4424-928e-96188e137a42 service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.481536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:11.486687 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2c67d-0117-4424-928e-96188e137a42 service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.492504 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.493171 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.493469 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.493781 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.506185 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ccd655c4b140aa9f7d7a61b117a7ec'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:11.515965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ccd655c4b140aa9f7d7a61b117a7ec'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:11.539732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ccd655c4b140aa9f7d7a61b117a7ec'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:11.540372 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ccd655c4b140aa9f7d7a61b117a7ec'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:11.550441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d3217bac-a5c7-49fd-87ee-1decc7e9d562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ccd655c4b140aa9f7d7a61b117a7ec'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:11.558276 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 936/1877] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:11 2022] DELETE /identity/v3/users/78ccd655c4b140aa9f7d7a61b117a7ec => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:11.562440 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3126fe-5870-4dc3-8e22-c219cab69d8b None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.562811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3126fe-5870-4dc3-8e22-c219cab69d8b None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.563187 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3126fe-5870-4dc3-8e22-c219cab69d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.578952 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.581584 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-fb3126fe-5870-4dc3-8e22-c219cab69d8b None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:11.582227 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.582898 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-fb3126fe-5870-4dc3-8e22-c219cab69d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:11.593681 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 942/1878] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:51:11.654792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 937/1879] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:11.666264 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:11.667857 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:11.751133 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac92a38-bc95-465e-a9f5-cb66552e8205 service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:11.809067 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc31b-ea6b-445f-bc50-99be8b52a71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:11.809754 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc31b-ea6b-445f-bc50-99be8b52a71b service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:11.810053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc31b-ea6b-445f-bc50-99be8b52a71b service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:11.810336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc31b-ea6b-445f-bc50-99be8b52a71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:11.820097 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc31b-ea6b-445f-bc50-99be8b52a71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:11.821598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc31b-ea6b-445f-bc50-99be8b52a71b service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:11.831622 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 943/1880] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:51:12.100293 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3126fe-5870-4dc3-8e22-c219cab69d8b None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.101709 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-fb3126fe-5870-4dc3-8e22-c219cab69d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:12.114965 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3126fe-5870-4dc3-8e22-c219cab69d8b None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.120532 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.121598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.121942 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.122214 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] PATH_INFO: `/v3/projects/ecf75bcdeadc4c88a4fc8840b8642a5e` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.123391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf75bcdeadc4c88a4fc8840b8642a5e)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:12.125833 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:12.143077 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:12.174910 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf75bcdeadc4c88a4fc8840b8642a5e', 'request_id': 'req-1c44e827-4d0b-4040-ab4d-94111458ff9d'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.181494 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf75bcdeadc4c88a4fc8840b8642a5e', 'request_id': 'req-1c44e827-4d0b-4040-ab4d-94111458ff9d'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.187034 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf75bcdeadc4c88a4fc8840b8642a5e', 'request_id': 'req-1c44e827-4d0b-4040-ab4d-94111458ff9d'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.199716 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] The token cache is being invalidate because project ecf75bcdeadc4c88a4fc8840b8642a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:12.200014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.200666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.202312 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 938/1881] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:12 2022] DELETE /identity/v3/projects/ecf75bcdeadc4c88a4fc8840b8642a5e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:12.206293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc31b-ea6b-445f-bc50-99be8b52a71b service neutron] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.215959 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc31b-ea6b-445f-bc50-99be8b52a71b service neutron] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.278008 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.278886 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.279169 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.279446 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] PATH_INFO: `/v3/users/a49502662aa64b619ec2522111145f40` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.280630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49502662aa64b619ec2522111145f40)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:12.282631 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:12.284311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=100 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:12.337650 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49502662aa64b619ec2522111145f40'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.346052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49502662aa64b619ec2522111145f40'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.346630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49502662aa64b619ec2522111145f40'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.354351 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49502662aa64b619ec2522111145f40'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.368280 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49502662aa64b619ec2522111145f40'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.374532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 944/1882] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:12 2022] DELETE /identity/v3/users/a49502662aa64b619ec2522111145f40 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:12.764244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.765987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:12.786869 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44e827-4d0b-4040-ab4d-94111458ff9d admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.854414 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:12.856480 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:12.902557 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:12.903714 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:12.904074 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:12.904491 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] PATH_INFO: `/v3/users/650ed280d898451883ebbac91f495eb3` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:12.906216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650ed280d898451883ebbac91f495eb3)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:12.908732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:12.984192 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650ed280d898451883ebbac91f495eb3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:12.992030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b61169-edb6-4167-b12b-bea5ec1e7686 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:12.993358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650ed280d898451883ebbac91f495eb3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.003770 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.004905 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.006921 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.007293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] PATH_INFO: `/v3/projects/5d884d7c3d634c9882fc84bf9f15812d` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.008606 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650ed280d898451883ebbac91f495eb3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.009387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650ed280d898451883ebbac91f495eb3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.010181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d884d7c3d634c9882fc84bf9f15812d)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.015560 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.032111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-662be29a-0561-48bb-852d-cfd844cf3b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650ed280d898451883ebbac91f495eb3'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.041098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 939/1883] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:12 2022] DELETE /identity/v3/users/650ed280d898451883ebbac91f495eb3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:13.046087 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679fa4c-f59e-44aa-90d3-81271a24a550 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.046681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679fa4c-f59e-44aa-90d3-81271a24a550 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.053704 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679fa4c-f59e-44aa-90d3-81271a24a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.079558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d884d7c3d634c9882fc84bf9f15812d', 'request_id': 'req-fd7d16de-7fbb-4854-9025-20c998eefdec'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.089448 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d884d7c3d634c9882fc84bf9f15812d', 'request_id': 'req-fd7d16de-7fbb-4854-9025-20c998eefdec'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.095665 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-1679fa4c-f59e-44aa-90d3-81271a24a550 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:13.096923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1679fa4c-f59e-44aa-90d3-81271a24a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:13.101253 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d884d7c3d634c9882fc84bf9f15812d', 'request_id': 'req-fd7d16de-7fbb-4854-9025-20c998eefdec'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.119794 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] The token cache is being invalidate because project 5d884d7c3d634c9882fc84bf9f15812d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:13.120287 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.121098 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-fd7d16de-7fbb-4854-9025-20c998eefdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.123146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:13.123474 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 945/1884] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:12 2022] DELETE /identity/v3/projects/5d884d7c3d634c9882fc84bf9f15812d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:13.128313 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd4213-5e51-4c65-9896-71039e5b41a7 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.128690 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd4213-5e51-4c65-9896-71039e5b41a7 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.129068 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd4213-5e51-4c65-9896-71039e5b41a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.151166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-cadd4213-5e51-4c65-9896-71039e5b41a7 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:13.152942 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-cadd4213-5e51-4c65-9896-71039e5b41a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:13.157081 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:13.174012 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 940/1885] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:13.185364 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679fa4c-f59e-44aa-90d3-81271a24a550 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.186977 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1679fa4c-f59e-44aa-90d3-81271a24a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:13.234532 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 946/1886] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:13.242375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a8394-8ee1-45bc-b170-4cb9fc8b1a44 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.242668 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a8394-8ee1-45bc-b170-4cb9fc8b1a44 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.242950 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a8394-8ee1-45bc-b170-4cb9fc8b1a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.261895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-984a8394-8ee1-45bc-b170-4cb9fc8b1a44 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:13.263131 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-984a8394-8ee1-45bc-b170-4cb9fc8b1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:13.265512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679fa4c-f59e-44aa-90d3-81271a24a550 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.269596 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86eaa5c-91b1-4f64-9cc4-cadd7419a8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.270288 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86eaa5c-91b1-4f64-9cc4-cadd7419a8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.270581 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86eaa5c-91b1-4f64-9cc4-cadd7419a8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.270867 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86eaa5c-91b1-4f64-9cc4-cadd7419a8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.277209 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 947/1887] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:13.278006 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a8394-8ee1-45bc-b170-4cb9fc8b1a44 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.282528 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86eaa5c-91b1-4f64-9cc4-cadd7419a8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.284323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86eaa5c-91b1-4f64-9cc4-cadd7419a8c8 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.287869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a8394-8ee1-45bc-b170-4cb9fc8b1a44 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.293293 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.294096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.294299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.294582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.295333 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:13.295630 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.296067 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 941/1888] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:13.298052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.316828 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 948/1889] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:13.322369 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86eaa5c-91b1-4f64-9cc4-cadd7419a8c8 service neutron] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.335640 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86eaa5c-91b1-4f64-9cc4-cadd7419a8c8 service neutron] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.342109 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd1985-fe7c-4569-99f1-5513662daa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.342954 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd1985-fe7c-4569-99f1-5513662daa83 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.343244 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd1985-fe7c-4569-99f1-5513662daa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.343529 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd1985-fe7c-4569-99f1-5513662daa83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.344305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd1985-fe7c-4569-99f1-5513662daa83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.349874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd1985-fe7c-4569-99f1-5513662daa83 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.374189 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 942/1890] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:13 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:13.378784 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.391101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b35d77-f72f-4c71-a792-08bcf8c783df admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.451223 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaee80a-b5f5-4960-9bc9-828c5809eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.452145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee80a-b5f5-4960-9bc9-828c5809eae9 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.452273 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee80a-b5f5-4960-9bc9-828c5809eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.452670 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee80a-b5f5-4960-9bc9-828c5809eae9 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.453438 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaee80a-b5f5-4960-9bc9-828c5809eae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.455648 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaee80a-b5f5-4960-9bc9-828c5809eae9 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.485804 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 949/1891] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:13 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:13.489219 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd1985-fe7c-4569-99f1-5513662daa83 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.501951 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd1985-fe7c-4569-99f1-5513662daa83 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.507992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01e41e-2828-45c7-8555-5692c8b61915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.508676 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01e41e-2828-45c7-8555-5692c8b61915 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.508960 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01e41e-2828-45c7-8555-5692c8b61915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.509239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01e41e-2828-45c7-8555-5692c8b61915 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.510365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01e41e-2828-45c7-8555-5692c8b61915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.511685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01e41e-2828-45c7-8555-5692c8b61915 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.525303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 943/1892] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:13.529666 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaee80a-b5f5-4960-9bc9-828c5809eae9 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.542423 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaee80a-b5f5-4960-9bc9-828c5809eae9 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.547332 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.548076 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.549195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.549195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.549379 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.550918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.567174 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 950/1893] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:13.570957 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01e41e-2828-45c7-8555-5692c8b61915 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.582479 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01e41e-2828-45c7-8555-5692c8b61915 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.588489 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03366c8-3945-46fd-8f9e-b2e275889856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.589552 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03366c8-3945-46fd-8f9e-b2e275889856 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.590016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03366c8-3945-46fd-8f9e-b2e275889856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.590228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03366c8-3945-46fd-8f9e-b2e275889856 admin admin] PATH_INFO: `/v3/projects/804fdf21569f4bb79d1575a6ed95286d/users/9287f1885c5e44b2ba8797014def6303/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.608336 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.611282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:13.612374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03366c8-3945-46fd-8f9e-b2e275889856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804fdf21569f4bb79d1575a6ed95286d, user_id=9287f1885c5e44b2ba8797014def6303, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.621002 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03366c8-3945-46fd-8f9e-b2e275889856 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.631311 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75bfb6-8833-49e9-93ab-f79732da8df2 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.648631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 944/1894] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:13 2022] PUT /identity/v3/projects/804fdf21569f4bb79d1575a6ed95286d/users/9287f1885c5e44b2ba8797014def6303/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:13.660493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c5ffa-f21d-4a17-bcac-9084487f40a1 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.660864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c5ffa-f21d-4a17-bcac-9084487f40a1 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.661223 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c5ffa-f21d-4a17-bcac-9084487f40a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.695797 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-504c5ffa-f21d-4a17-bcac-9084487f40a1 None None] MFA Rules not processed for user `9287f1885c5e44b2ba8797014def6303`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:13.697642 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-504c5ffa-f21d-4a17-bcac-9084487f40a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:13.703049 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.704003 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.704362 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.704715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] PATH_INFO: `/v3/projects/73c2656890b54a409546cfe6997ca45d` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.705995 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c2656890b54a409546cfe6997ca45d)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.708103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.720400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:13.777884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c2656890b54a409546cfe6997ca45d', 'request_id': 'req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.789226 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c2656890b54a409546cfe6997ca45d', 'request_id': 'req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.789449 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:13.798393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 945/1895] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:13.799426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c2656890b54a409546cfe6997ca45d', 'request_id': 'req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.800387 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c5ffa-f21d-4a17-bcac-9084487f40a1 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.812725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c5ffa-f21d-4a17-bcac-9084487f40a1 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.813214 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] The token cache is being invalidate because project 73c2656890b54a409546cfe6997ca45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:13.813512 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.814189 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:13.815777 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 951/1896] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:13 2022] DELETE /identity/v3/projects/73c2656890b54a409546cfe6997ca45d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:13.820281 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.821876 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:13.873599 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.875738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.875738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.875738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.875738 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.877495 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.909600 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 946/1897] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:13 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:13.910798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9b01a-c7da-4488-8cbf-d27ab6def30d admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.914996 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:13.916685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:13.986115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc4d52-7cb6-4b6b-b612-7f129f078afe admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:13.986751 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.987641 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.987918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.988195 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] PATH_INFO: `/v3/users/dc9a152f04224cc4ae8433058e5c5d6a` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.990312 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9a152f04224cc4ae8433058e5c5d6a)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.992448 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76e09-9634-41a1-b961-f2febe88684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:13.993140 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76e09-9634-41a1-b961-f2febe88684b admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:13.993358 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:13.993451 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76e09-9634-41a1-b961-f2febe88684b admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:13.993700 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76e09-9634-41a1-b961-f2febe88684b admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:13.994815 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe76e09-9634-41a1-b961-f2febe88684b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:13.996712 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe76e09-9634-41a1-b961-f2febe88684b admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.022866 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 947/1898] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:13 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:14.027631 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76e09-9634-41a1-b961-f2febe88684b admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.046040 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76e09-9634-41a1-b961-f2febe88684b admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.053143 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5792b4-a37f-4e7e-b59f-da7c174a9225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.054414 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5792b4-a37f-4e7e-b59f-da7c174a9225 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.054711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5792b4-a37f-4e7e-b59f-da7c174a9225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.054989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5792b4-a37f-4e7e-b59f-da7c174a9225 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.055803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5792b4-a37f-4e7e-b59f-da7c174a9225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:14.057429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5792b4-a37f-4e7e-b59f-da7c174a9225 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.064392 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9a152f04224cc4ae8433058e5c5d6a'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.066324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:14.069334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 948/1899] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:14.074271 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5792b4-a37f-4e7e-b59f-da7c174a9225 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.083400 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9a152f04224cc4ae8433058e5c5d6a'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.084243 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9a152f04224cc4ae8433058e5c5d6a'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.086641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5792b4-a37f-4e7e-b59f-da7c174a9225 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.092975 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715ef58-f906-48da-9569-e0faf4d676af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.093964 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715ef58-f906-48da-9569-e0faf4d676af admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.094530 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715ef58-f906-48da-9569-e0faf4d676af admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.094864 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715ef58-f906-48da-9569-e0faf4d676af admin admin] PATH_INFO: `/v3/projects/b048fef3724e4edba9dce5a5a42f2c9f/users/af1f693148274788adf9b7113848f93e/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.094977 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9a152f04224cc4ae8433058e5c5d6a'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.110204 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9a152f04224cc4ae8433058e5c5d6a'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.124998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715ef58-f906-48da-9569-e0faf4d676af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b048fef3724e4edba9dce5a5a42f2c9f, user_id=af1f693148274788adf9b7113848f93e, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:14.128510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715ef58-f906-48da-9569-e0faf4d676af admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.136052 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 952/1900] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:13 2022] DELETE /identity/v3/users/dc9a152f04224cc4ae8433058e5c5d6a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:14.153885 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 949/1901] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:14 2022] PUT /identity/v3/projects/b048fef3724e4edba9dce5a5a42f2c9f/users/af1f693148274788adf9b7113848f93e/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:14.155005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.156450 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:14.241206 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77d57-f576-46e7-918e-5c4a7019ae9e admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.315858 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf579c-fbee-4310-9915-87f600a72d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.316664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf579c-fbee-4310-9915-87f600a72d83 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.317023 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf579c-fbee-4310-9915-87f600a72d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.317645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf579c-fbee-4310-9915-87f600a72d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.318216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf579c-fbee-4310-9915-87f600a72d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:14.319970 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf579c-fbee-4310-9915-87f600a72d83 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.333373 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 953/1902] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:14.338345 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715ef58-f906-48da-9569-e0faf4d676af admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.371030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715ef58-f906-48da-9569-e0faf4d676af admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.381418 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.383152 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.384158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.384550 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] PATH_INFO: `/v3/projects/b048fef3724e4edba9dce5a5a42f2c9f/users/af1f693148274788adf9b7113848f93e/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.390783 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b048fef3724e4edba9dce5a5a42f2c9f, user_id=af1f693148274788adf9b7113848f93e, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:14.394666 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.415899 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 950/1903] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:14 2022] PUT /identity/v3/projects/b048fef3724e4edba9dce5a5a42f2c9f/users/af1f693148274788adf9b7113848f93e/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:14.429057 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71080d-7215-49de-a104-15690adc33d6 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.429917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71080d-7215-49de-a104-15690adc33d6 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.430475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71080d-7215-49de-a104-15690adc33d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.496861 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-1e71080d-7215-49de-a104-15690adc33d6 None None] MFA Rules not processed for user `af1f693148274788adf9b7113848f93e`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:14.498181 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-1e71080d-7215-49de-a104-15690adc33d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:14.574618 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.576905 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:14.596060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:14.616598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 954/1904] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:14.624887 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71080d-7215-49de-a104-15690adc33d6 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.628893 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-1e71080d-7215-49de-a104-15690adc33d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:14.640146 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:14.690014 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4443-9f70-4892-9d93-e7c0c70a1811 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.695455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.696329 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.696617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.696900 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] PATH_INFO: `/v3/projects/23b06c9687174980b88b7960684f46a3` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.698122 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b06c9687174980b88b7960684f46a3)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:14.700227 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.704705 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71080d-7215-49de-a104-15690adc33d6 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.709186 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201779c2-6c22-4843-b43c-78063091befc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.710790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201779c2-6c22-4843-b43c-78063091befc service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.712076 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201779c2-6c22-4843-b43c-78063091befc service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.712375 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201779c2-6c22-4843-b43c-78063091befc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.725645 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201779c2-6c22-4843-b43c-78063091befc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:14.727141 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201779c2-6c22-4843-b43c-78063091befc service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:14.741848 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 955/1905] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:14.762525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b06c9687174980b88b7960684f46a3', 'request_id': 'req-81551b32-52ed-423f-80fa-fe59fede062c'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.769605 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b06c9687174980b88b7960684f46a3', 'request_id': 'req-81551b32-52ed-423f-80fa-fe59fede062c'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.782510 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b06c9687174980b88b7960684f46a3', 'request_id': 'req-81551b32-52ed-423f-80fa-fe59fede062c'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.812353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] The token cache is being invalidate because project 23b06c9687174980b88b7960684f46a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:14.812353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.812353 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-81551b32-52ed-423f-80fa-fe59fede062c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:14.813026 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 951/1906] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:14 2022] DELETE /identity/v3/projects/23b06c9687174980b88b7960684f46a3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:14.818462 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0a33b-cf75-4350-90c8-947bb0601143 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.818761 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0a33b-cf75-4350-90c8-947bb0601143 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.819575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0a33b-cf75-4350-90c8-947bb0601143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.847205 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-8ff0a33b-cf75-4350-90c8-947bb0601143 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:14.849667 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-8ff0a33b-cf75-4350-90c8-947bb0601143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:14.936807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 956/1907] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:14.945986 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608dd67-7f60-40d5-8929-b3a973cb6864 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.946728 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608dd67-7f60-40d5-8929-b3a973cb6864 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.947037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608dd67-7f60-40d5-8929-b3a973cb6864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.966659 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-1608dd67-7f60-40d5-8929-b3a973cb6864 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:14.968128 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1608dd67-7f60-40d5-8929-b3a973cb6864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:14.976246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 952/1908] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:14.980556 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0a33b-cf75-4350-90c8-947bb0601143 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:14.991509 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0a33b-cf75-4350-90c8-947bb0601143 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:14.996547 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:14.997246 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:14.997538 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:14.997860 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:14.998606 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:14.998921 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.000560 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.013508 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 957/1909] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 13:51:15.018132 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608dd67-7f60-40d5-8929-b3a973cb6864 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.028295 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608dd67-7f60-40d5-8929-b3a973cb6864 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.033018 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87d973-1dfe-48cd-b9bd-a89dd2aec421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.033685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d973-1dfe-48cd-b9bd-a89dd2aec421 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.034024 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d973-1dfe-48cd-b9bd-a89dd2aec421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.034303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d973-1dfe-48cd-b9bd-a89dd2aec421 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.035273 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87d973-1dfe-48cd-b9bd-a89dd2aec421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.037166 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87d973-1dfe-48cd-b9bd-a89dd2aec421 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.064365 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 953/1910] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:15 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:15.070331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.081237 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca105a55-29d9-4b55-bf83-006b819e0e65 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.144949 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc722e03-26ef-4de0-bcd1-e87147dd3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.146415 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc722e03-26ef-4de0-bcd1-e87147dd3f84 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.146762 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc722e03-26ef-4de0-bcd1-e87147dd3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.146994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc722e03-26ef-4de0-bcd1-e87147dd3f84 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.149388 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc722e03-26ef-4de0-bcd1-e87147dd3f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.153923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc722e03-26ef-4de0-bcd1-e87147dd3f84 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.179794 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 958/1911] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:15 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:15.181796 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87d973-1dfe-48cd-b9bd-a89dd2aec421 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.192938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87d973-1dfe-48cd-b9bd-a89dd2aec421 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.200398 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe2acf-9127-4cd8-addd-fda953fda14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.201161 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2acf-9127-4cd8-addd-fda953fda14d admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.201517 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2acf-9127-4cd8-addd-fda953fda14d admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.201895 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2acf-9127-4cd8-addd-fda953fda14d admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.202710 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe2acf-9127-4cd8-addd-fda953fda14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.205239 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe2acf-9127-4cd8-addd-fda953fda14d admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.217776 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 954/1912] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:15.222152 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc722e03-26ef-4de0-bcd1-e87147dd3f84 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.234707 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc722e03-26ef-4de0-bcd1-e87147dd3f84 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.243798 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfffc27-e01c-46af-8a45-06256a7db77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.244499 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfffc27-e01c-46af-8a45-06256a7db77c admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.244765 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfffc27-e01c-46af-8a45-06256a7db77c admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.245047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfffc27-e01c-46af-8a45-06256a7db77c admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.245824 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfffc27-e01c-46af-8a45-06256a7db77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.247445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfffc27-e01c-46af-8a45-06256a7db77c admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.261252 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 959/1913] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:15.265429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe2acf-9127-4cd8-addd-fda953fda14d admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.276466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe2acf-9127-4cd8-addd-fda953fda14d admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.282863 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.283770 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.284141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.284341 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] PATH_INFO: `/v3/projects/7a1972fee88b4ee984558a2bb60160e3/users/b209ba94101d460a96b07229bd407542/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.305079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1972fee88b4ee984558a2bb60160e3, user_id=b209ba94101d460a96b07229bd407542, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.307998 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.330425 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 955/1914] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:15 2022] PUT /identity/v3/projects/7a1972fee88b4ee984558a2bb60160e3/users/b209ba94101d460a96b07229bd407542/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:15.345790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989566e0-bbfc-41cc-9c1e-6f484b2a0ac3 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.345790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989566e0-bbfc-41cc-9c1e-6f484b2a0ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.345790 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989566e0-bbfc-41cc-9c1e-6f484b2a0ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.351649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.383912 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-989566e0-bbfc-41cc-9c1e-6f484b2a0ac3 None None] MFA Rules not processed for user `b209ba94101d460a96b07229bd407542`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:15.386492 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-989566e0-bbfc-41cc-9c1e-6f484b2a0ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:15.435258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.437539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:15.486101 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 960/1915] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:15.491005 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989566e0-bbfc-41cc-9c1e-6f484b2a0ac3 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.510897 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.518221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01df772-289c-4976-a3bc-1c20d8baadc9 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.526267 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.527164 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.527507 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.527794 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] PATH_INFO: `/v3/users/9287f1885c5e44b2ba8797014def6303` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.529056 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9287f1885c5e44b2ba8797014def6303)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.531054 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.575574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989566e0-bbfc-41cc-9c1e-6f484b2a0ac3 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.581320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaab661-8cd1-441f-9d5d-4daa76521bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.582203 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaab661-8cd1-441f-9d5d-4daa76521bde admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.582736 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaab661-8cd1-441f-9d5d-4daa76521bde admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.583164 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaab661-8cd1-441f-9d5d-4daa76521bde admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.584670 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaab661-8cd1-441f-9d5d-4daa76521bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.587680 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaab661-8cd1-441f-9d5d-4daa76521bde admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.601718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9287f1885c5e44b2ba8797014def6303'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:15.609432 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9287f1885c5e44b2ba8797014def6303'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:15.617725 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 961/1916] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:15 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:15.621580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaab661-8cd1-441f-9d5d-4daa76521bde admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.630354 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9287f1885c5e44b2ba8797014def6303'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:15.631165 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9287f1885c5e44b2ba8797014def6303'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:15.638902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-3372b52a-5fd6-47fa-a75d-fe545bb29599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9287f1885c5e44b2ba8797014def6303'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:15.645793 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 956/1917] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:15 2022] DELETE /identity/v3/users/9287f1885c5e44b2ba8797014def6303 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:15.650758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bca3e-0be6-4794-a6e7-97fe9647c178 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.651057 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bca3e-0be6-4794-a6e7-97fe9647c178 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.651348 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bca3e-0be6-4794-a6e7-97fe9647c178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.669251 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-670bca3e-0be6-4794-a6e7-97fe9647c178 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:15.670424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-670bca3e-0be6-4794-a6e7-97fe9647c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:15.690015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaab661-8cd1-441f-9d5d-4daa76521bde admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.711020 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.731949 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 957/1918] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:15.742466 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bca3e-0be6-4794-a6e7-97fe9647c178 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.743868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-670bca3e-0be6-4794-a6e7-97fe9647c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:15.751391 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.752071 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.752378 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.752743 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.753465 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.755442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.777593 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 962/1919] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:15 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 13:51:15.782836 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.784946 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:15.797962 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d746b3-b7ff-4330-b463-851c6f6b1166 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.804172 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bca3e-0be6-4794-a6e7-97fe9647c178 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.804426 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476821ba-8ea3-400d-b325-9bc284f9be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.805103 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476821ba-8ea3-400d-b325-9bc284f9be0a admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.805394 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476821ba-8ea3-400d-b325-9bc284f9be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.805676 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476821ba-8ea3-400d-b325-9bc284f9be0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.806439 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476821ba-8ea3-400d-b325-9bc284f9be0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.808138 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476821ba-8ea3-400d-b325-9bc284f9be0a admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.808248 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed716f-9f8e-4c86-960f-cdff12c38894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.808784 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed716f-9f8e-4c86-960f-cdff12c38894 service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.809068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed716f-9f8e-4c86-960f-cdff12c38894 service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.809519 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed716f-9f8e-4c86-960f-cdff12c38894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.822044 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 963/1920] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:15.822290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed716f-9f8e-4c86-960f-cdff12c38894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.822290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed716f-9f8e-4c86-960f-cdff12c38894 service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.823994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476821ba-8ea3-400d-b325-9bc284f9be0a admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.833216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 958/1921] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:51:15.834604 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476821ba-8ea3-400d-b325-9bc284f9be0a admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.839675 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534c91-3f00-4fc3-9639-5bb3ed79a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.840588 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534c91-3f00-4fc3-9639-5bb3ed79a422 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.841306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534c91-3f00-4fc3-9639-5bb3ed79a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.841306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534c91-3f00-4fc3-9639-5bb3ed79a422 admin admin] PATH_INFO: `/v3/projects/0b516da173b442ef87cca786efc7d65d/users/05474c879fad4b5c9fa6c7f62b1d9f38/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.858700 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534c91-3f00-4fc3-9639-5bb3ed79a422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b516da173b442ef87cca786efc7d65d, user_id=05474c879fad4b5c9fa6c7f62b1d9f38, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.861981 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534c91-3f00-4fc3-9639-5bb3ed79a422 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.877060 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 964/1922] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:15 2022] PUT /identity/v3/projects/0b516da173b442ef87cca786efc7d65d/users/05474c879fad4b5c9fa6c7f62b1d9f38/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:15.881327 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed716f-9f8e-4c86-960f-cdff12c38894 service neutron] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:15.892767 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed716f-9f8e-4c86-960f-cdff12c38894 service neutron] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:15.902887 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:15.962682 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5b71d-bbf7-45a6-a02d-7517ed37935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:15.963732 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b71d-bbf7-45a6-a02d-7517ed37935f admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:15.964065 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b71d-bbf7-45a6-a02d-7517ed37935f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:15.964411 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b71d-bbf7-45a6-a02d-7517ed37935f admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:15.965447 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5b71d-bbf7-45a6-a02d-7517ed37935f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:15.968417 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5b71d-bbf7-45a6-a02d-7517ed37935f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:15.981775 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 959/1923] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:15.985096 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534c91-3f00-4fc3-9639-5bb3ed79a422 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.001463 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534c91-3f00-4fc3-9639-5bb3ed79a422 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.006371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.008778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.008778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.010323 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] PATH_INFO: `/v3/projects/0b516da173b442ef87cca786efc7d65d/users/05474c879fad4b5c9fa6c7f62b1d9f38/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.012456 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b516da173b442ef87cca786efc7d65d, user_id=05474c879fad4b5c9fa6c7f62b1d9f38, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.015167 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.027208 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 965/1924] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:15 2022] PUT /identity/v3/projects/0b516da173b442ef87cca786efc7d65d/users/05474c879fad4b5c9fa6c7f62b1d9f38/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:16.037945 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7777c9-a344-4d9f-a5ae-df5c8a4693af None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.038252 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7777c9-a344-4d9f-a5ae-df5c8a4693af None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.038539 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7777c9-a344-4d9f-a5ae-df5c8a4693af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.066506 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-0e7777c9-a344-4d9f-a5ae-df5c8a4693af None None] MFA Rules not processed for user `05474c879fad4b5c9fa6c7f62b1d9f38`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:16.067751 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-0e7777c9-a344-4d9f-a5ae-df5c8a4693af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:16.140323 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 960/1925] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:16.141963 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.143907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:16.151737 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7777c9-a344-4d9f-a5ae-df5c8a4693af None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.153163 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-0e7777c9-a344-4d9f-a5ae-df5c8a4693af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:16.212303 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7777c9-a344-4d9f-a5ae-df5c8a4693af None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.216030 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809bb44-8423-4d9f-b0fb-c14bc35b081f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.216668 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809bb44-8423-4d9f-b0fb-c14bc35b081f service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.217308 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809bb44-8423-4d9f-b0fb-c14bc35b081f service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.217603 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809bb44-8423-4d9f-b0fb-c14bc35b081f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.227344 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809bb44-8423-4d9f-b0fb-c14bc35b081f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.228792 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809bb44-8423-4d9f-b0fb-c14bc35b081f service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.229826 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438e6bb-b878-4c0e-9eb7-7241baaf0715 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.234869 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.235797 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.236082 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.236390 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] PATH_INFO: `/v3/projects/804fdf21569f4bb79d1575a6ed95286d` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.237584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=804fdf21569f4bb79d1575a6ed95286d)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.238856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 961/1926] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:51:16.239580 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.289507 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804fdf21569f4bb79d1575a6ed95286d', 'request_id': 'req-9db14362-61ae-45e5-9957-0518555addc0'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.297073 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804fdf21569f4bb79d1575a6ed95286d', 'request_id': 'req-9db14362-61ae-45e5-9957-0518555addc0'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.302906 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804fdf21569f4bb79d1575a6ed95286d', 'request_id': 'req-9db14362-61ae-45e5-9957-0518555addc0'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.306566 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:16.318248 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] The token cache is being invalidate because project 804fdf21569f4bb79d1575a6ed95286d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:16.318537 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.319918 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.321660 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 966/1927] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:16 2022] DELETE /identity/v3/projects/804fdf21569f4bb79d1575a6ed95286d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:16.325819 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809bb44-8423-4d9f-b0fb-c14bc35b081f service cinder] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.337623 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809bb44-8423-4d9f-b0fb-c14bc35b081f service cinder] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.374163 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=100 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:16.399045 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.399936 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.400228 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.400512 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] PATH_INFO: `/v3/users/af1f693148274788adf9b7113848f93e` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.401718 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1f693148274788adf9b7113848f93e)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.404535 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.471706 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1f693148274788adf9b7113848f93e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.481039 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1f693148274788adf9b7113848f93e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.499428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1f693148274788adf9b7113848f93e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.500426 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1f693148274788adf9b7113848f93e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.516446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-93188ff3-5e73-4a31-b944-bd9b3ac433ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1f693148274788adf9b7113848f93e'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.525868 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 962/1928] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:16 2022] DELETE /identity/v3/users/af1f693148274788adf9b7113848f93e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:16.636090 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.637541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:16.652741 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db14362-61ae-45e5-9957-0518555addc0 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:16.748473 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:16.749459 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.749774 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.750166 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] PATH_INFO: `/v3/users/b209ba94101d460a96b07229bd407542` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.751749 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b209ba94101d460a96b07229bd407542)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:16.753607 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:16.817325 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b209ba94101d460a96b07229bd407542'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.826092 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b209ba94101d460a96b07229bd407542'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.826830 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b209ba94101d460a96b07229bd407542'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.835077 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b209ba94101d460a96b07229bd407542'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.857100 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b209ba94101d460a96b07229bd407542'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:16.864306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 967/1929] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:16 2022] DELETE /identity/v3/users/b209ba94101d460a96b07229bd407542 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:16.869758 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c13835-19d2-414a-8040-c2eed5fce845 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:16.870216 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c13835-19d2-414a-8040-c2eed5fce845 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:16.870489 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c13835-19d2-414a-8040-c2eed5fce845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:16.888801 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-22c13835-19d2-414a-8040-c2eed5fce845 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:16.890331 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-22c13835-19d2-414a-8040-c2eed5fce845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:16.952950 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 963/1930] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:16.983029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:16.984562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.051180 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c13835-19d2-414a-8040-c2eed5fce845 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.054182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-22c13835-19d2-414a-8040-c2eed5fce845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.063553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35af0b-526d-402c-a398-d081ff67e623 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.069786 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd1ce8-689b-40a1-9473-e0f2a906ca85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.069991 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c13835-19d2-414a-8040-c2eed5fce845 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.070710 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1ce8-689b-40a1-9473-e0f2a906ca85 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.071234 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1ce8-689b-40a1-9473-e0f2a906ca85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.071615 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd1ce8-689b-40a1-9473-e0f2a906ca85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.076429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.077424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.078060 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.078326 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] PATH_INFO: `/v3/projects/b048fef3724e4edba9dce5a5a42f2c9f` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.079715 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b048fef3724e4edba9dce5a5a42f2c9f)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.081525 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.086566 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd1ce8-689b-40a1-9473-e0f2a906ca85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.088326 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd1ce8-689b-40a1-9473-e0f2a906ca85 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.099638 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 968/1931] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:17.134825 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b048fef3724e4edba9dce5a5a42f2c9f', 'request_id': 'req-083871ef-96c1-4d2d-a503-a52cd6972e25'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.136743 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.142182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b048fef3724e4edba9dce5a5a42f2c9f', 'request_id': 'req-083871ef-96c1-4d2d-a503-a52cd6972e25'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.150670 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b048fef3724e4edba9dce5a5a42f2c9f', 'request_id': 'req-083871ef-96c1-4d2d-a503-a52cd6972e25'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.165059 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] The token cache is being invalidate because project b048fef3724e4edba9dce5a5a42f2c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:17.165468 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.166658 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-083871ef-96c1-4d2d-a503-a52cd6972e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.169261 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 964/1932] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:17 2022] DELETE /identity/v3/projects/b048fef3724e4edba9dce5a5a42f2c9f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:17.175882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0ed1-6b7e-4e0f-a644-a1f9153652b4 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.176475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0ed1-6b7e-4e0f-a644-a1f9153652b4 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.176896 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0ed1-6b7e-4e0f-a644-a1f9153652b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.196738 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-8fdd0ed1-6b7e-4e0f-a644-a1f9153652b4 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:17.198045 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-8fdd0ed1-6b7e-4e0f-a644-a1f9153652b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.213444 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.266376 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 969/1933] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:17.274811 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a8446-42b4-4def-b911-9c19c0630928 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.275106 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a8446-42b4-4def-b911-9c19c0630928 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.275390 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a8446-42b4-4def-b911-9c19c0630928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.294690 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-029a8446-42b4-4def-b911-9c19c0630928 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:17.295902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-029a8446-42b4-4def-b911-9c19c0630928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.304138 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 965/1934] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:17.308495 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd0ed1-6b7e-4e0f-a644-a1f9153652b4 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.318478 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd0ed1-6b7e-4e0f-a644-a1f9153652b4 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.323310 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.324089 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.324467 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.324818 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.325590 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:17.325961 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.327602 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.347704 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 970/1935] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:17.352566 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a8446-42b4-4def-b911-9c19c0630928 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.363923 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a8446-42b4-4def-b911-9c19c0630928 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.368121 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c86cc-ac67-4898-9515-b0fed4788375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.368816 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c86cc-ac67-4898-9515-b0fed4788375 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.369107 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c86cc-ac67-4898-9515-b0fed4788375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.369393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c86cc-ac67-4898-9515-b0fed4788375 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.370156 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c86cc-ac67-4898-9515-b0fed4788375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.372151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c86cc-ac67-4898-9515-b0fed4788375 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.385855 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.387807 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.401445 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 966/1936] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:17 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:17.405641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c86cc-ac67-4898-9515-b0fed4788375 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.410261 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a54e3-4fe9-418a-bd8b-4ee8d66ecaac admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.470433 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.471296 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.471582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.471862 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] PATH_INFO: `/v3/projects/7a1972fee88b4ee984558a2bb60160e3` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.473036 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1972fee88b4ee984558a2bb60160e3)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.474979 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.477458 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c86cc-ac67-4898-9515-b0fed4788375 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.482215 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdbd9f-e86c-4a96-ad12-8656a064533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.482877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdbd9f-e86c-4a96-ad12-8656a064533b admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.483169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdbd9f-e86c-4a96-ad12-8656a064533b admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.483501 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdbd9f-e86c-4a96-ad12-8656a064533b admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.484224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdbd9f-e86c-4a96-ad12-8656a064533b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.486746 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdbd9f-e86c-4a96-ad12-8656a064533b admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.512016 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 967/1937] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:17 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:17.512894 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdbd9f-e86c-4a96-ad12-8656a064533b admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.522589 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdbd9f-e86c-4a96-ad12-8656a064533b admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.525999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1972fee88b4ee984558a2bb60160e3', 'request_id': 'req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.532945 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1972fee88b4ee984558a2bb60160e3', 'request_id': 'req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.539144 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1972fee88b4ee984558a2bb60160e3', 'request_id': 'req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.551153 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] The token cache is being invalidate because project 7a1972fee88b4ee984558a2bb60160e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:17.551457 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.552247 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.554397 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 971/1938] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:17 2022] DELETE /identity/v3/projects/7a1972fee88b4ee984558a2bb60160e3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:17.558297 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.559642 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.587641 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.588455 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.588740 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.589020 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.589802 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.591573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.602992 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 968/1939] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:17.605286 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.607193 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.609011 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.622328 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1135-86a8-44a2-a50c-885bbfebd5a3 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.627061 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377051f9-4efb-4a2a-966a-eac1a11eba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.627742 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377051f9-4efb-4a2a-966a-eac1a11eba0f admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.628033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377051f9-4efb-4a2a-966a-eac1a11eba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.628340 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377051f9-4efb-4a2a-966a-eac1a11eba0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.629079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377051f9-4efb-4a2a-966a-eac1a11eba0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.630725 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377051f9-4efb-4a2a-966a-eac1a11eba0f admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.633241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51cf4d-02d8-475b-a193-65a5ae09c9ed admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.638054 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.638935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.639331 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.639703 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] PATH_INFO: `/v3/users/05474c879fad4b5c9fa6c7f62b1d9f38` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.640703 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 969/1940] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:17.640948 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05474c879fad4b5c9fa6c7f62b1d9f38)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.642916 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.644874 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377051f9-4efb-4a2a-966a-eac1a11eba0f admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.654523 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377051f9-4efb-4a2a-966a-eac1a11eba0f admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.659200 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123305bb-be44-499b-9ac5-b60c6e8747cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.660095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123305bb-be44-499b-9ac5-b60c6e8747cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.660381 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123305bb-be44-499b-9ac5-b60c6e8747cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.660663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123305bb-be44-499b-9ac5-b60c6e8747cd admin admin] PATH_INFO: `/v3/projects/d7c7896faa0f49d386305a8d31e1b0f1/users/98824df3b32c43faaf2d04d610ce3370/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.677399 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123305bb-be44-499b-9ac5-b60c6e8747cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c7896faa0f49d386305a8d31e1b0f1, user_id=98824df3b32c43faaf2d04d610ce3370, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.680877 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123305bb-be44-499b-9ac5-b60c6e8747cd admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.692584 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05474c879fad4b5c9fa6c7f62b1d9f38'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.694115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 970/1941] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:17 2022] PUT /identity/v3/projects/d7c7896faa0f49d386305a8d31e1b0f1/users/98824df3b32c43faaf2d04d610ce3370/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:17.699582 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05474c879fad4b5c9fa6c7f62b1d9f38'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.700353 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05474c879fad4b5c9fa6c7f62b1d9f38'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.710053 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05474c879fad4b5c9fa6c7f62b1d9f38'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.710741 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69688-7a3b-4e9e-bde1-df3b44ebc975 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.711037 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69688-7a3b-4e9e-bde1-df3b44ebc975 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.711321 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69688-7a3b-4e9e-bde1-df3b44ebc975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.717544 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:17.733999 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05474c879fad4b5c9fa6c7f62b1d9f38'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:17.743286 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 972/1942] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:17 2022] DELETE /identity/v3/users/05474c879fad4b5c9fa6c7f62b1d9f38 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:17.750257 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-72a69688-7a3b-4e9e-bde1-df3b44ebc975 None None] MFA Rules not processed for user `98824df3b32c43faaf2d04d610ce3370`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:17.751489 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-72a69688-7a3b-4e9e-bde1-df3b44ebc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.846155 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 971/1943] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:17.859383 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:17.861239 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:17.944282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f484-6552-4298-96ac-b41554a09f4a admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:17.948993 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95004d-7f86-401f-a10c-e2692cdb4afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:17.949802 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95004d-7f86-401f-a10c-e2692cdb4afc service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:17.950179 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95004d-7f86-401f-a10c-e2692cdb4afc service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:17.950475 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95004d-7f86-401f-a10c-e2692cdb4afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:17.962443 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95004d-7f86-401f-a10c-e2692cdb4afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:17.964387 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95004d-7f86-401f-a10c-e2692cdb4afc service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:17.978129 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 973/1944] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:18.442852 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a69688-7a3b-4e9e-bde1-df3b44ebc975 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.446753 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-72a69688-7a3b-4e9e-bde1-df3b44ebc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:18.540667 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a69688-7a3b-4e9e-bde1-df3b44ebc975 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.545393 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.546311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.546602 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.546892 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] PATH_INFO: `/v3/projects/0b516da173b442ef87cca786efc7d65d` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.548115 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b516da173b442ef87cca786efc7d65d)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:18.550111 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:18.599883 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b516da173b442ef87cca786efc7d65d', 'request_id': 'req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:18.606096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b516da173b442ef87cca786efc7d65d', 'request_id': 'req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:18.611637 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b516da173b442ef87cca786efc7d65d', 'request_id': 'req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:18.624687 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] The token cache is being invalidate because project 0b516da173b442ef87cca786efc7d65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:18.625009 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:18.625699 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-6111ef1d-8a08-4dda-8c14-8120fc84b4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:18.627307 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 972/1945] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:18 2022] DELETE /identity/v3/projects/0b516da173b442ef87cca786efc7d65d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:18.633721 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857affeb-4554-4540-9b5e-84e321c66e14 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.634241 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857affeb-4554-4540-9b5e-84e321c66e14 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.634320 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857affeb-4554-4540-9b5e-84e321c66e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.653121 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-857affeb-4554-4540-9b5e-84e321c66e14 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:18.654377 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-857affeb-4554-4540-9b5e-84e321c66e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:18.706920 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:18.721940 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 974/1946] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:18.726483 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caf79e-537d-44ed-8758-7b0a40cc2ae5 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.726803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caf79e-537d-44ed-8758-7b0a40cc2ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.727095 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caf79e-537d-44ed-8758-7b0a40cc2ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.746871 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-47caf79e-537d-44ed-8758-7b0a40cc2ae5 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:18.748082 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-47caf79e-537d-44ed-8758-7b0a40cc2ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:18.759832 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 973/1947] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:18.761047 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857affeb-4554-4540-9b5e-84e321c66e14 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.770911 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857affeb-4554-4540-9b5e-84e321c66e14 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.775715 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.776486 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.776785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.777061 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] PATH_INFO: `/v3/domains` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.777812 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:18.778185 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:18.781845 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:18.794187 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 975/1948] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:18.798592 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caf79e-537d-44ed-8758-7b0a40cc2ae5 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.808663 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caf79e-537d-44ed-8758-7b0a40cc2ae5 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.813382 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6985f-048e-4f1c-902c-501cecfbcaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.814116 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6985f-048e-4f1c-902c-501cecfbcaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.814405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6985f-048e-4f1c-902c-501cecfbcaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.814681 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6985f-048e-4f1c-902c-501cecfbcaf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.815374 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6985f-048e-4f1c-902c-501cecfbcaf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:18.817290 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6985f-048e-4f1c-902c-501cecfbcaf6 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:18.831395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:18.845686 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 974/1949] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:18 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:18.849659 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.860318 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02316115-8e76-43e7-8255-fa0effacb96d admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:18.930884 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8d3df-5e95-4618-9134-39e1bc805058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:18.931748 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d3df-5e95-4618-9134-39e1bc805058 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:18.932219 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d3df-5e95-4618-9134-39e1bc805058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:18.932518 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d3df-5e95-4618-9134-39e1bc805058 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:18.933432 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8d3df-5e95-4618-9134-39e1bc805058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:18.935692 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8d3df-5e95-4618-9134-39e1bc805058 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:18.976990 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 976/1950] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:18 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:18.981190 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6985f-048e-4f1c-902c-501cecfbcaf6 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:18.994531 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6985f-048e-4f1c-902c-501cecfbcaf6 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.000015 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88644c84-4a6e-4776-a801-7d6ad33e24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.000719 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88644c84-4a6e-4776-a801-7d6ad33e24de admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.000989 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88644c84-4a6e-4776-a801-7d6ad33e24de admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.001296 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88644c84-4a6e-4776-a801-7d6ad33e24de admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.002112 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88644c84-4a6e-4776-a801-7d6ad33e24de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.003733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88644c84-4a6e-4776-a801-7d6ad33e24de admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.021865 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8d3df-5e95-4618-9134-39e1bc805058 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.025856 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 975/1951] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:19.033321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8d3df-5e95-4618-9134-39e1bc805058 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.039861 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9ee97-2f87-49c7-9db0-6d5f837f8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.040562 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9ee97-2f87-49c7-9db0-6d5f837f8a1d admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.040881 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9ee97-2f87-49c7-9db0-6d5f837f8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.041145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9ee97-2f87-49c7-9db0-6d5f837f8a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.041934 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9ee97-2f87-49c7-9db0-6d5f837f8a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.043717 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9ee97-2f87-49c7-9db0-6d5f837f8a1d admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.055225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 977/1952] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:19.059395 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88644c84-4a6e-4776-a801-7d6ad33e24de admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.071396 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88644c84-4a6e-4776-a801-7d6ad33e24de admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.077920 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783f65e-e92d-483b-8cb4-18ba18f36396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.079068 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f65e-e92d-483b-8cb4-18ba18f36396 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.079420 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f65e-e92d-483b-8cb4-18ba18f36396 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.079767 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f65e-e92d-483b-8cb4-18ba18f36396 admin admin] PATH_INFO: `/v3/projects/bd60d10664be4f63974f8bc89f0e14bd/users/4d0a4ab7f15a47a49d1ad14f46036c29/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.110836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783f65e-e92d-483b-8cb4-18ba18f36396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd60d10664be4f63974f8bc89f0e14bd, user_id=4d0a4ab7f15a47a49d1ad14f46036c29, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.116999 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783f65e-e92d-483b-8cb4-18ba18f36396 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.159829 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 976/1953] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:19 2022] PUT /identity/v3/projects/bd60d10664be4f63974f8bc89f0e14bd/users/4d0a4ab7f15a47a49d1ad14f46036c29/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:19.171536 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37808a-1ef3-4f44-bb8c-45e8c1253580 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.171834 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37808a-1ef3-4f44-bb8c-45e8c1253580 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.172122 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37808a-1ef3-4f44-bb8c-45e8c1253580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.239857 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-cc37808a-1ef3-4f44-bb8c-45e8c1253580 None None] MFA Rules not processed for user `4d0a4ab7f15a47a49d1ad14f46036c29`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:19.242125 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-cc37808a-1ef3-4f44-bb8c-45e8c1253580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:19.407852 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 978/1954] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:19.408717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783f65e-e92d-483b-8cb4-18ba18f36396 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.596441 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783f65e-e92d-483b-8cb4-18ba18f36396 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.604711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250084a0-c7e9-4b0f-9c3d-d8216e238a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.605413 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250084a0-c7e9-4b0f-9c3d-d8216e238a45 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.605705 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250084a0-c7e9-4b0f-9c3d-d8216e238a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.606079 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250084a0-c7e9-4b0f-9c3d-d8216e238a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.606821 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250084a0-c7e9-4b0f-9c3d-d8216e238a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.608969 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250084a0-c7e9-4b0f-9c3d-d8216e238a45 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.659941 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 977/1955] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:19 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:19.663528 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37808a-1ef3-4f44-bb8c-45e8c1253580 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.675895 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37808a-1ef3-4f44-bb8c-45e8c1253580 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.752567 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:19.770871 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa810d8d-4f75-4ae5-82db-a44d51ce4711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.771831 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa810d8d-4f75-4ae5-82db-a44d51ce4711 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.772159 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa810d8d-4f75-4ae5-82db-a44d51ce4711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.772447 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa810d8d-4f75-4ae5-82db-a44d51ce4711 admin admin] PATH_INFO: `/v3/users` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.773158 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa810d8d-4f75-4ae5-82db-a44d51ce4711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.775255 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa810d8d-4f75-4ae5-82db-a44d51ce4711 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.799771 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 979/1956] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:19 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:19.804306 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250084a0-c7e9-4b0f-9c3d-d8216e238a45 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.815839 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250084a0-c7e9-4b0f-9c3d-d8216e238a45 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.821258 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d40be1-94c3-45bf-b20f-6d813c36eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.822124 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d40be1-94c3-45bf-b20f-6d813c36eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.822424 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d40be1-94c3-45bf-b20f-6d813c36eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.822711 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d40be1-94c3-45bf-b20f-6d813c36eb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.823446 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d40be1-94c3-45bf-b20f-6d813c36eb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.825169 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d40be1-94c3-45bf-b20f-6d813c36eb09 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.840616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 978/1957] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:19.842514 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa810d8d-4f75-4ae5-82db-a44d51ce4711 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.856106 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa810d8d-4f75-4ae5-82db-a44d51ce4711 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:19.863836 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bbd8d-048b-4c22-9644-b6b7c0405f40 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.866620 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bbd8d-048b-4c22-9644-b6b7c0405f40 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.867283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bbd8d-048b-4c22-9644-b6b7c0405f40 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.867763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f3e9-485d-41f7-b12f-49be1fe44c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:19.869084 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f3e9-485d-41f7-b12f-49be1fe44c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.869533 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f3e9-485d-41f7-b12f-49be1fe44c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.869808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 979/1958] 10.222.0.13 () {54 vars in 921 bytes} [Wed May 25 13:51:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 13:51:19.869943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f3e9-485d-41f7-b12f-49be1fe44c95 admin admin] PATH_INFO: `/v3/projects/9430b7b17ca94a79885ad37098c999b4/users/4735d6c846d541458491f426cfc5223a/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.890717 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4ca19-95e5-484d-9743-fce7341940b6 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:19.890923 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f3e9-485d-41f7-b12f-49be1fe44c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9430b7b17ca94a79885ad37098c999b4, user_id=4735d6c846d541458491f426cfc5223a, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:19.891377 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4ca19-95e5-484d-9743-fce7341940b6 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:19.891967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4ca19-95e5-484d-9743-fce7341940b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:19.893909 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f3e9-485d-41f7-b12f-49be1fe44c95 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:19.915445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 980/1959] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:19 2022] PUT /identity/v3/projects/9430b7b17ca94a79885ad37098c999b4/users/4735d6c846d541458491f426cfc5223a/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:19.932932 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f3e9-485d-41f7-b12f-49be1fe44c95 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:19.944958 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-a7d4ca19-95e5-484d-9743-fce7341940b6 None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:19.946246 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-a7d4ca19-95e5-484d-9743-fce7341940b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:20.029638 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f3e9-485d-41f7-b12f-49be1fe44c95 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.044865 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 980/1960] 10.222.0.13 () {58 vars in 1018 bytes} [Wed May 25 13:51:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:20.045586 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.046321 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.046611 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.046894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.047646 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.049291 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.062847 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 981/1961] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:20.067858 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4ca19-95e5-484d-9743-fce7341940b6 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:20.088558 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:20.091655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:20.095568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4ca19-95e5-484d-9743-fce7341940b6 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.111023 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ee705-c355-4df9-8caf-e46bedd31ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.113952 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ee705-c355-4df9-8caf-e46bedd31ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.114311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ee705-c355-4df9-8caf-e46bedd31ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.115279 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ee705-c355-4df9-8caf-e46bedd31ce1 admin admin] PATH_INFO: `/v3/projects/9430b7b17ca94a79885ad37098c999b4/users/4735d6c846d541458491f426cfc5223a/roles/0432fca4ca7844c3b92bc4860d8756ec` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.118356 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ee705-c355-4df9-8caf-e46bedd31ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9430b7b17ca94a79885ad37098c999b4, user_id=4735d6c846d541458491f426cfc5223a, role_id=0432fca4ca7844c3b92bc4860d8756ec)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.119969 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54947e3a-9637-466c-a630-4a46805d02b7 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.121493 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ee705-c355-4df9-8caf-e46bedd31ce1 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.133935 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.134958 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 981/1962] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:20 2022] PUT /identity/v3/projects/9430b7b17ca94a79885ad37098c999b4/users/4735d6c846d541458491f426cfc5223a/roles/0432fca4ca7844c3b92bc4860d8756ec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:20.135763 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.136059 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.136348 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.150098 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762280e2-428b-48ae-8ea3-3b9b21b0c9bc None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.154284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762280e2-428b-48ae-8ea3-3b9b21b0c9bc None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.154284 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762280e2-428b-48ae-8ea3-3b9b21b0c9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.172676 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.174833 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.182721 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:20.219352 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-762280e2-428b-48ae-8ea3-3b9b21b0c9bc None None] MFA Rules not processed for user `4735d6c846d541458491f426cfc5223a`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:20.219937 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 982/1963] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:20.220617 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-762280e2-428b-48ae-8ea3-3b9b21b0c9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:20.374733 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 982/1964] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:20.406994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:20.408785 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:20.515324 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170e6f2-d43a-49d9-baa7-faaa10f9c88e service nova] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:20.619474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a372e-b4af-4cb9-938d-e64647b83110 None None] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.619987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a372e-b4af-4cb9-938d-e64647b83110 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.619987 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a372e-b4af-4cb9-938d-e64647b83110 None None] PATH_INFO: `/` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.621269 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 983/1965] 10.222.0.13 () {54 vars in 921 bytes} [Wed May 25 13:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 13:51:20.637524 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf75107-b7e9-45a8-85bd-4098d0d8744b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:20.638029 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf75107-b7e9-45a8-85bd-4098d0d8744b service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.638318 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf75107-b7e9-45a8-85bd-4098d0d8744b service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.638598 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf75107-b7e9-45a8-85bd-4098d0d8744b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.651429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4249402-14d5-458a-a539-9a3325b0bdcd None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:20.651726 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4249402-14d5-458a-a539-9a3325b0bdcd None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:20.652415 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4249402-14d5-458a-a539-9a3325b0bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:20.664210 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:20.688472 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-b4249402-14d5-458a-a539-9a3325b0bdcd None None] MFA Rules not processed for user `7ac29fbb131c4ccf9ee7f26c4bd6523c`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:20.690217 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b4249402-14d5-458a-a539-9a3325b0bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:20.796899 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf75107-b7e9-45a8-85bd-4098d0d8744b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:20.798421 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf75107-b7e9-45a8-85bd-4098d0d8744b service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:20.817245 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 983/1966] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:20.836224 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 984/1967] 10.222.0.13 () {58 vars in 1018 bytes} [Wed May 25 13:51:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:21.086031 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf75107-b7e9-45a8-85bd-4098d0d8744b service cinder] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:21.101641 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf75107-b7e9-45a8-85bd-4098d0d8744b service cinder] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:21.109760 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13517f-83d3-41c6-9e7b-fd03b3e2828f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac29fbb131c4ccf9ee7f26c4bd6523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:21.110553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13517f-83d3-41c6-9e7b-fd03b3e2828f service nova] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:21.110941 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13517f-83d3-41c6-9e7b-fd03b3e2828f service nova] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:21.111327 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13517f-83d3-41c6-9e7b-fd03b3e2828f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:21.126978 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13517f-83d3-41c6-9e7b-fd03b3e2828f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:21.130308 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13517f-83d3-41c6-9e7b-fd03b3e2828f service nova] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:21.166973 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 984/1968] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 13:51:28.023405 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4249402-14d5-458a-a539-9a3325b0bdcd None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.025013 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-b4249402-14d5-458a-a539-9a3325b0bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:28.096221 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4249402-14d5-458a-a539-9a3325b0bdcd None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.101862 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.102764 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.103053 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.103334 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] PATH_INFO: `/v3/users/98824df3b32c43faaf2d04d610ce3370` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.104646 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98824df3b32c43faaf2d04d610ce3370)` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.106689 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.148464 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:28.170795 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98824df3b32c43faaf2d04d610ce3370'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.180148 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98824df3b32c43faaf2d04d610ce3370'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.194204 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98824df3b32c43faaf2d04d610ce3370'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.194935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98824df3b32c43faaf2d04d610ce3370'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.205808 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.notifications [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98824df3b32c43faaf2d04d610ce3370'} {{(pid=86847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.213713 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 985/1969] 10.222.0.13 () {58 vars in 1223 bytes} [Wed May 25 13:51:28 2022] DELETE /identity/v3/users/98824df3b32c43faaf2d04d610ce3370 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 13:51:28.218612 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc322d-09ff-4519-86c0-e58f2d233963 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.219088 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc322d-09ff-4519-86c0-e58f2d233963 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.219201 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc322d-09ff-4519-86c0-e58f2d233963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.244216 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-bfcc322d-09ff-4519-86c0-e58f2d233963 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:28.245497 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-bfcc322d-09ff-4519-86c0-e58f2d233963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:28.314564 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 985/1970] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:28.324542 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.326175 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:28.396979 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399db2-0d00-4ce0-bf5b-686ea9b67434 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.400915 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242258b-5748-48c2-8f4a-079962aa9aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.401573 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242258b-5748-48c2-8f4a-079962aa9aed service neutron] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.401908 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242258b-5748-48c2-8f4a-079962aa9aed service neutron] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.402305 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242258b-5748-48c2-8f4a-079962aa9aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.412233 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242258b-5748-48c2-8f4a-079962aa9aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.414268 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242258b-5748-48c2-8f4a-079962aa9aed service neutron] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.424358 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 986/1971] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:28.718425 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc322d-09ff-4519-86c0-e58f2d233963 None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.720634 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-bfcc322d-09ff-4519-86c0-e58f2d233963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:28.737411 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc322d-09ff-4519-86c0-e58f2d233963 None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.742943 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.743917 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.744404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.744882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] PATH_INFO: `/v3/projects/d7c7896faa0f49d386305a8d31e1b0f1` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.746856 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c7896faa0f49d386305a8d31e1b0f1)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.749553 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.810030 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c7896faa0f49d386305a8d31e1b0f1', 'request_id': 'req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.816154 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c7896faa0f49d386305a8d31e1b0f1', 'request_id': 'req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.821574 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c7896faa0f49d386305a8d31e1b0f1', 'request_id': 'req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8'} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.833600 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] The token cache is being invalidate because project d7c7896faa0f49d386305a8d31e1b0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 13:51:28.834015 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.835145 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.notifications [None req-dd7a2b81-318f-4472-9bcb-c244d52cc1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 13:51:28.836695 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 986/1972] 10.222.0.13 () {58 vars in 1232 bytes} [Wed May 25 13:51:28 2022] DELETE /identity/v3/projects/d7c7896faa0f49d386305a8d31e1b0f1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:28.841484 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d3b0-843d-451e-9410-3c55d6f71465 None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.842050 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d3b0-843d-451e-9410-3c55d6f71465 None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.842332 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d3b0-843d-451e-9410-3c55d6f71465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.860803 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-3a12d3b0-843d-451e-9410-3c55d6f71465 None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:28.862029 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-3a12d3b0-843d-451e-9410-3c55d6f71465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:28.919442 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 987/1973] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:28.927306 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c928e5-870a-4253-9852-3727626d1c6a None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.927602 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c928e5-870a-4253-9852-3727626d1c6a None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.927888 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c928e5-870a-4253-9852-3727626d1c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.946374 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-14c928e5-870a-4253-9852-3727626d1c6a None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:28.947577 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-14c928e5-870a-4253-9852-3727626d1c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:28.955435 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 987/1974] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:28.960317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12d3b0-843d-451e-9410-3c55d6f71465 None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:28.970203 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12d3b0-843d-451e-9410-3c55d6f71465 None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:28.974826 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:28.975485 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:28.975773 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:28.976055 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] PATH_INFO: `/v3/domains` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:28.976780 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 13:51:28.977096 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:28.978748 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:28.990317 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 988/1975] 10.222.0.13 () {58 vars in 1152 bytes} [Wed May 25 13:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 13:51:28.998055 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c928e5-870a-4253-9852-3727626d1c6a None None] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.004231 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c928e5-870a-4253-9852-3727626d1c6a None None] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.009907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b450366-2a0a-42e4-9341-47a0d0e1f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.010583 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b450366-2a0a-42e4-9341-47a0d0e1f0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.010872 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b450366-2a0a-42e4-9341-47a0d0e1f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.011156 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b450366-2a0a-42e4-9341-47a0d0e1f0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.011914 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b450366-2a0a-42e4-9341-47a0d0e1f0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.013907 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b450366-2a0a-42e4-9341-47a0d0e1f0b5 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.028442 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.044894 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 988/1976] 10.222.0.13 () {60 vars in 1152 bytes} [Wed May 25 13:51:28 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:29.049366 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.059938 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12c02d-6b5c-4401-9d72-99740ddaf89a admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.097967 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:29.124259 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041cb0a-138e-4f1b-bd4b-f9e6d09e4de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.124616 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041cb0a-138e-4f1b-bd4b-f9e6d09e4de8 admin admin] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.124902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041cb0a-138e-4f1b-bd4b-f9e6d09e4de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.125186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041cb0a-138e-4f1b-bd4b-f9e6d09e4de8 admin admin] PATH_INFO: `/v3/users` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.125935 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041cb0a-138e-4f1b-bd4b-f9e6d09e4de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.128134 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041cb0a-138e-4f1b-bd4b-f9e6d09e4de8 admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.152906 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 989/1977] 10.222.0.13 () {60 vars in 1143 bytes} [Wed May 25 13:51:29 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 13:51:29.157314 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b450366-2a0a-42e4-9341-47a0d0e1f0b5 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.170655 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b450366-2a0a-42e4-9341-47a0d0e1f0b5 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.176980 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fda0d9-dbb7-435d-8a83-3688ceb229ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.177664 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fda0d9-dbb7-435d-8a83-3688ceb229ad admin admin] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.178016 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fda0d9-dbb7-435d-8a83-3688ceb229ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.178299 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fda0d9-dbb7-435d-8a83-3688ceb229ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.179037 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fda0d9-dbb7-435d-8a83-3688ceb229ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.180640 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fda0d9-dbb7-435d-8a83-3688ceb229ad admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.191851 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 989/1978] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 13:51:29.196315 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041cb0a-138e-4f1b-bd4b-f9e6d09e4de8 admin admin] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.206800 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041cb0a-138e-4f1b-bd4b-f9e6d09e4de8 admin admin] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.213313 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca3344-9053-4c42-affb-0d422787181a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.214141 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca3344-9053-4c42-affb-0d422787181a admin admin] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.214504 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca3344-9053-4c42-affb-0d422787181a admin admin] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.215655 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca3344-9053-4c42-affb-0d422787181a admin admin] PATH_INFO: `/v3/roles` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.216474 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca3344-9053-4c42-affb-0d422787181a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.219072 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca3344-9053-4c42-affb-0d422787181a admin admin] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.232355 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 990/1979] 10.222.0.13 () {58 vars in 1121 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 13:51:29.241229 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fda0d9-dbb7-435d-8a83-3688ceb229ad admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.252714 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fda0d9-dbb7-435d-8a83-3688ceb229ad admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.258980 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082a7280c91e421382a44e080705c894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48375e55fddc4df099c1a83243da1d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.259882 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] REQUEST_METHOD: `PUT` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.260175 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.260461 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] PATH_INFO: `/v3/projects/df509da611924e3fbffa6baf4b49e68f/users/e9b24300d10947a0be8526c6c8d48b94/roles/6076bee6c25b4df5bfbd3f00b06c314b` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.287769 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df509da611924e3fbffa6baf4b49e68f, user_id=e9b24300d10947a0be8526c6c8d48b94, role_id=6076bee6c25b4df5bfbd3f00b06c314b)` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.290485 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.310778 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 990/1980] 10.222.0.13 () {60 vars in 1482 bytes} [Wed May 25 13:51:29 2022] PUT /identity/v3/projects/df509da611924e3fbffa6baf4b49e68f/users/e9b24300d10947a0be8526c6c8d48b94/roles/6076bee6c25b4df5bfbd3f00b06c314b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 13:51:29.315376 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb75b-50b6-4bac-92f0-c1fc754f5f3f None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.315672 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb75b-50b6-4bac-92f0-c1fc754f5f3f None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.315963 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eb75b-50b6-4bac-92f0-c1fc754f5f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.340210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-137eb75b-50b6-4bac-92f0-c1fc754f5f3f None None] MFA Rules not processed for user `082a7280c91e421382a44e080705c894`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:29.341422 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-137eb75b-50b6-4bac-92f0-c1fc754f5f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:29.406685 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 991/1981] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:29.416282 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:29.418723 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:29.489987 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1a5d5-330f-4556-98f4-00418fb88002 admin admin] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:29.489987 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d7bc855c20b431b9aabaee20101b79c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:29.491225 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:29.491575 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:29.491988 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:29.503019 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:29.504874 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:29.517649 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 991/1982] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:30.519968 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f37d4-a734-4ed4-8f4b-1947f1b19cfa None None] REQUEST_METHOD: `POST` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.520429 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f37d4-a734-4ed4-8f4b-1947f1b19cfa None None] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.520568 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f37d4-a734-4ed4-8f4b-1947f1b19cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.548412 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.auth.core [None req-681f37d4-a734-4ed4-8f4b-1947f1b19cfa None None] MFA Rules not processed for user `e9b24300d10947a0be8526c6c8d48b94`. Rule list: `[]` (Enabled: `True`). {{(pid=86847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:30.549692 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-681f37d4-a734-4ed4-8f4b-1947f1b19cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:30.625391 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 992/1983] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 13:51:30.633794 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] Authenticating user token {{(pid=86846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:30.635247 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:30.700420 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0376b74-0d5f-47f7-8cdf-53da94e45280 service neutron] Validating token access rules against request {{(pid=86846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:30.704452 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb0bbc-3de0-4a93-a96f-5775c8227bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:30.705118 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb0bbc-3de0-4a93-a96f-5775c8227bdb service cinder] REQUEST_METHOD: `GET` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:30.705404 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb0bbc-3de0-4a93-a96f-5775c8227bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:30.705679 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb0bbc-3de0-4a93-a96f-5775c8227bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:30.720111 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb0bbc-3de0-4a93-a96f-5775c8227bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:30.721994 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb0bbc-3de0-4a93-a96f-5775c8227bdb service cinder] RBAC: Authorization granted {{(pid=86846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:30.736256 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 992/1984] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:35.154158 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f37d4-a734-4ed4-8f4b-1947f1b19cfa None None] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:51:35.156428 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-681f37d4-a734-4ed4-8f4b-1947f1b19cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:35.171598 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f37d4-a734-4ed4-8f4b-1947f1b19cfa None None] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:51:35.175367 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c27e8bab1f3424aadd7ca66a1e2756f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:51:35.176033 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.176325 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.176608 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.178728 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:35.239182 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:35.263371 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024cfc-5078-4f28-9599-d8a1ba572028 None None] REQUEST_METHOD: `POST` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:51:35.264265 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024cfc-5078-4f28-9599-d8a1ba572028 None None] SCRIPT_NAME: `/identity` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:51:35.264718 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024cfc-5078-4f28-9599-d8a1ba572028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:51:35.269812 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:51:35.271311 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:51:35.282779 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 993/1985] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:51:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:51:35.285275 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.auth.core [None req-36024cfc-5078-4f28-9599-d8a1ba572028 None None] MFA Rules not processed for user `e9b24300d10947a0be8526c6c8d48b94`. Rule list: `[]` (Enabled: `True`). {{(pid=86846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 13:51:35.286541 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG keystone.common.fernet_utils [None req-36024cfc-5078-4f28-9599-d8a1ba572028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:51:35.297445 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: [pid: 86846|app: 0|req: 993/1986] 10.222.0.13 () {58 vars in 957 bytes} [Wed May 25 13:51:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 13:51:45.277948 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=9 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:51:45.280202 dv-cinder-787296-8-iscsi devstack@keystone.service[86846]: DEBUG dbcounter [-] [86846] Writing DB stats keystone:INSERT=2,keystone:SELECT=72 {{(pid=86846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 13:54:36.364735 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] Authenticating user token {{(pid=86847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 13:54:36.366151 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:54:36.502210 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469fc78-e69e-44c9-895f-2cc78c14b372 service cinder] Validating token access rules against request {{(pid=86847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 13:54:36.507245 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cc77f-1427-4a5b-b28a-7fb27e13b9ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba5bb1004bdc4e74809cc8e43b5d9e16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0b98559906540c082df06432223b497', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 13:54:36.507902 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cc77f-1427-4a5b-b28a-7fb27e13b9ba service placement] REQUEST_METHOD: `GET` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 13:54:36.508186 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cc77f-1427-4a5b-b28a-7fb27e13b9ba service placement] SCRIPT_NAME: `/identity` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 13:54:36.508470 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cc77f-1427-4a5b-b28a-7fb27e13b9ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 13:54:36.510283 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.fernet_utils [None req-882cc77f-1427-4a5b-b28a-7fb27e13b9ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 13:54:36.522209 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cc77f-1427-4a5b-b28a-7fb27e13b9ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 13:54:36.523850 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cc77f-1427-4a5b-b28a-7fb27e13b9ba service placement] RBAC: Authorization granted {{(pid=86847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 13:54:36.533634 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: [pid: 86847|app: 0|req: 994/1987] 10.222.0.13 () {60 vars in 1365 bytes} [Wed May 25 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 13:54:46.529561 dv-cinder-787296-8-iscsi devstack@keystone.service[86847]: DEBUG dbcounter [-] [86847] Writing DB stats keystone:SELECT=63 {{(pid=86847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}